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Preface 


This book is intended to serve the dual function of being: (1) a reference 
book for engineers engaged in research and development involving simula- 
tion in industrial, government, and educational institutions, and (2) a 
teaching text at the advanced senior or graduate level. Even when used as 
a teaching text, this book has served to fulfill the first function mentioned 
above. About half of the students who took the University of Connecticut 
course associated with this text were full-time engineers enrolled as graduate 
University Extension students who often applied the material to their 
current work. Through them and the very useful feedback they provided, 
this book was made more meaningful and more applicable to real life 
situations than if it had evolved in a purely academic atmosphere. The 
author’s own industrial consulting experience also contributed in a similar 
manner. 

The material in this book has been used at the University of Connec- 
ticut in a six-credit course that extended over a full academic year. Although 
listed as a course in Electrical Engineering, it has been completed very 
successfully by students from other engineering disciplines. A student with 
weak or almost no knowledge of electronic circuits will be hampered only 
slightly as far as the analog-computer techniques discussed here are con- 
cerned; he will have no problem at all with digital techniques. On the other 
hand, some prior knowledge of system theory is essential; the student 
should know how to use the Laplace transform in at least simple system 
problems. Some digital-computer programming ability is necessary, but the 
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programming language to which the engineer or student is accustomed is 
unimportant as long as the language is scientifically oriented. Algorithms 
are described by general flow diagrams that do not depend upon a knowl- 
edge of any particular programming language syntax. 

With the two-semester arrangement in use at the University of Con- 
necticut, it was found possible to reach the end of Chapter 5 during 
the first semester and to cover the entire book by the end of the second term. 
A few quizzes were found useful for student evaluation during the first 
semester, but even then, most of the grading was based on individual student 
projects. Ideas for such projects sometimes arose from the problems sug- 
gested at the ends of the chapters, but they also evolved from other prob- 
lems the students had encountered in related engineering or academic 
work. 

The author has had the satisfaction of seeing a number of students 
make very effective use of the material in this book in their subsequent 
research work. For this reason, it is suggested that the student take a related 
course very early in his academic program enabling him to employ his 
knowledge of the subject in his thesis or other research efforts. 

All of the computer programs proposed here have been tried and their 
validity verified, using the facilities of the University of Connecticut’s Com- 
puter Center. 

This work was supported in part by funds granted to the Center under 
National Science Foundation Grant GJ-9. 

The author is deeply indebted to those students who, during the past 
few years, have taken the course related to this book while it was being 
taught from the author’s notes. They not only uncovered a number 
of errors, but they also made many valuable suggestions that subsequently 
have been incorporated in the text. They provided the author with con- 
siderable encouragement as well. One of these, Mr. George Starkweather, 
now with Martin Marietta Corp. of Orlando, Florida, did a very conscien- 
tious and thorough job of proofreading the galleys. 

The author is especially grateful to Mrs. Carolyn J. Turcio for her 
very excellent typing of the long and tedious manuscript, her painstaking 
drawing of the artwork of the original notes, and also for her many useful 
suggestions for improvement in style. 


R. J. KOCHENBURGER 
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Fundamental Simulation ] 
Techniques: An Example 


1-1 Introduction 


The use of computers for the purpose of simulating systems problems is 
explained most effectively by proceeding directly to a typical example that 
illustrates the most commonly encountered techniques. The types of simula- 
tion problems to be considered here, for the most part, will be dynamic 
problems, involving systems where the performance variation as a function 
of time is of interest. Such dynamic systems are encountered in many engi- 
neering problems, [1, 2]' in operations-research types of problems, in bio- 
logical systems, and in such sociodynamic areas as econometrics [3]. 

The example used here will refer to a very simple problem involving 
a mechanical-dynamic system consisting of a mass suspended on a spring 
and subjected to damping action. This particular type of problem frequently 
appears in more complicated form in the study of mechanical vibration 
and related problems, such as vehicle suspension. It is chosen because the 
physics involved in the analysis leading to the development of the simula- 
tion procedure (programming) will depend on principles that are generally 
well understood, in contrast to the more specialized fields to which simula- 
tion techniques might also be applied. 

To avoid undue complication at this stage, the problem chosen as 


1Numbers in brackets refer to the References at the ends of the chapters. 
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an example happens to be one in which a “pencil-and-paper” analysis could 
be applied without undue difficulty. The question could therefore be raised 
as to why computer simulation is advisable. The answer to this is probably 
obvious; such simulation procedures would not be necessary or show any 
advantages in so oversimplified a system. On the other hand, so simple a 
system would never be encountered exactly in practice, except as a very 
approximate version of a true physical situation. When the approximations 
are removed to obtain a more realistic version of the true system, an exact 
understanding of what the system does will be possible only by computer 
simulation procedures. 


1-2 Description of the Problem Used 
in This Example 


The problem used in this example is illustrated in Figure 1-1. 


Misa mass, constrained to move only vertically, of inertia, M = 0.5 kg 

k is a spring of spring rate, k = 20 kg/em 

B is a viscous type of linear damper of damping constant, B = 0.05 
kg/(cm/sec) 

x is the vertical position of the lower support, measured from some 
fixed reference and positive when upward, measured in centi- 
meters 

y is the vertical position of the center of M, considered as zero when 
k is at “free length” with x =0 and positive when upward, 
measured in centimeters 


It should be noted that the inertia and mass of the spring and the mass and 
resilience of the damper are all neglected. This is therefore a /Jumped-param- 
eter approximation of a real situation. The assumption of a linear damper, 
B, is also an approximation of the true nonlinear state of affairs applying 
in most practical situations. 

The above system is to be simulated so that the motion of the mass may 


F indication of y 


MMO E indication of x 


FIGURE 1-1 
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be expressed in terms of its displacement, y, for various motions of the 
support [i.e., for various prescribed functions, x(¢)]. 


1-3  Block-Diagram Description of the Problem 


A more thorough understanding of the system being simulated may be 
obtained by expressing in the form of a block diagram? the various mathe- 
matical relations that apply. Such a diagram gives a graphical picture of the 
flow of “cause and effect.” It is useful for a theoretical analysis of systems 
as well as for the programming of either an analog or a digital simulation 
procedure. 

In the preceding statements, the words “cause and effect” were used 
- with the full realization that in many processes it is difficult to establish 
which of two related phenomena is the cause and which the effect. In such 
instances the choice is arbitrary. However, with simulation procedures the 
fact must be kept in mind that all computation techniques perform inte- 
gration more readily than differentiation. For this reason it is preferable 
to establish a cause-and-effect relationship in the block diagram that leads 
to integral (rather than differential) equation form. 

The spring force will be defined as f, kilograms (positive for compres- 
sion) and, assuming a linear spring obeying Hooke’s law, will be given by 

fp =Kx—y) kg (1-1) 

This operation is shown symbolically in the block diagram by a rectangle, 
as shown in Figure 1-2a. 

The dashpot force is defined as f, kg and (based on the stated assump- 
tion of linear damping) is given by the relation 


fa=BS(x—y) kg 


The “dot notation” will be employed here; a single dot means the first time 
derivative, two dots, the second, etc. Then 
fo=BR—J) ke (1-2) 
This is shown symbolically in Figure 1-2b. 
The net force acting on the mass M is the sum of f, and f, less the 


FIGURE 1-2a FIGURE 1-2b 


2A simplified and compact form of block diagram, known as a signal-flow diagram, 
is also used, particularly with complicated configurations. 
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gravity force of Mkg, or 
Iu =f + fo —M kg (1-3) 
a7 
wn This is shown symbolically in Figure 1-2c. (The circular symbol implies 
~~ algebraic summation. The absence of a minus sign next to an entering arrow 


indicates that the quantity involved is to be added.) 
The acceleration of the mass, expressed in dot notation, will be simply 


p= Ef (1-4) 
This is shown symbolically in Figure 1-2d. 
M 
oy e 
tg 
FIGURE 1-2c FIGURE 1-2d 


The velocity of the mass, M, is simply the time integral of the accele- 
ration, or 


j= [par 
This will be written in operational form, where s indicates the operation, 
d/dt, and hence 1/s indicates the operation of time integration, as 
1 


p==S (1-5) 
shown symbolically in Figure 1-2e. Similarly, 
es 
yas (1-6) 
FIGURE 1-2e FIGURE 1-2f 


as shown symbolically in Figure 1-2f. Finally, by algebraic definition, 
@—y)=x—y (1-7) 
GH—y)=2—/Y (1-8) 
as shown by Figures 1-2g and 1-2h. 
In summary, all the operations described by relations (1-1) to (1-8) 


can be expressed in block-diagram form, as shown in Figure 1-3, which is 
useful for portraying the problem graphically; its configuration is identical 
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» x (x -y) 


x @-y) y 


FIGURE 1-29 FIGURE 1-2h 


independent . 
variables 
or 
“inputs” 
(functions 


FIGURE 1-3 


to the actual configuration of the connections between elements when an 
analog computer is employed for simulation. If a digital computer is to be 
employed for simulation, the direction of cause and effect (indicated by the 
arrows) is indicative of the sequence in which variables of interest will be 
computed. 

Algebraic simplification of the block diagram is possible. For example, 
the blocks g/M and 1/s could be combined to a single block, g/Ms. This 
would, however, eliminate the intervening acceleration variable, , from 
the problem and this variable no longer would be indicated by the simula- 
tion procedure. Such block-diagram simplifications are more appropriate 
for purposes of pencil-and-paper analyses than for simulation models. 


1-4 State-Variable Viewpoint 


Relations (1-1) to (1-8) could have been combined into a single differential 
equation. This would have been the usual procedure for a pencil-and-paper 
analysis of the system but is not required when computer-simulation tech- 
niques are to be employed. For this example, such a differential equation 
would have been of second order. Hence, the system being considered here 
would be described as a two-state system. From the simulation viewpoint, 
this fact is of interest for a number of reasons. Among them are the facts 
that 


1, The minimum number of time-integration operations to be per- 
formed is two. [Use of more integrating operations would not only 
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be wasteful of equipment or (with a digital simulator) of execution 
time, but could also introduce errors or convergence difficulties.] 
This minimum number does not include additional integrators 
sometimes required to generate the stipulated independent vari- 
ables; these integrators are not part of the system simulation pro- 
per. 

2. The relations given do not describe the system completely. As 
many boundary values must also be stated as there are system states, 
in this case two. 


The boundary values are frequently, but not necessarily, initial conditions 
of the system. Cases of stipulated boundary values other than initial con- 
ditions represent more difficult simulation problems and will be referred to 
as boundary-value problems. For this example, it will be assumed that there 
are two known initial conditions, the initial displacement (0), and the 
initial velocity (0). These, plus a definition of the independent variables 
x and x as functions of time, will be sufficient to describe the disturbance 
situation to which this spring-mass system is being subjected. Two such 
initial conditions are sufficient since this is a two-state system; as a matter 
of fact, the statement of a third initial condition would simply be contra- 
dictory or ambiguous. 

Almost any two of the variables appearing in the preceding block 
diagram could have been chosen as state variables, to be employed when 
writing the two state equations of the system. However, the most logical 
choice of state variable is y itself, which for state-variable purposes will be 
designated as y). The second most logical choice is the velocity j, which 
will be designated in state-variable notation as ),. 

In general, the state equations for any linear system will have the form 


4 ty) = [lly] + (Dl (1-9) 
where, for an n-state system, [y,] is the column matrix or “vector” 
Yo | 
WA 
Vn 


[A] will be an n X n matrix, [u,] will -be an mth-order vector [where m is the 
number of independent variables (other than time) that might affect the 
system], and [D] is an x m matrix describing the assumed linear effect 
of these disturbances. 

In this example, m = 2, and [)] is a two-element vector. There are three 
disturbances (independent variables other than time): x =X 9; ¥ =x,; 
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and the acceleration of gravity, g, related to the weight force; hence m = 3. 
The state equations may be obtained directly from inspection of the 
block diagram or by combining relations (1-1) to (1-8); they are 


d 
oa = y, (1-10) 
k B 
oH Mm? — 74" + ix t ex, & (1-11) 
or, in matrix notation, 
1 0 0 0 07] Xo 
yi y 
al -[-¢ al | B = 23) hse (1212) 
v1 mM  M\” |u mM ¢ 
Hence, with reference to relation (1-9), 
y a 
pi-[**| wa) =| x, 
Vi 
g& 


1 0 0 0 0 
, Sa 
M M M M p 


The vector block diagram describing relation (1-9) is shown in Figure 1-4. 


disturbance 
vector 


response vector 


ty} 


FIGURE 1-4 


Such a vector diagram is useful for the purpose of generalized analyses relat- 
ing to questions of system stability and control but normally would not be 
applied for the purpose of programming a simulation technique. The state- 
variable viewpoint does tell one that this example relates to a two-state 
system and, therefore, that a well-designed simulation system would involve 
no more than two integrators. 


1-5 Alternative Block Diagrams 


The following system of equations could have been written for this example 
and would have furnished an equally valid description of the dynamics of 
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this system: 


y=x—@—-y)  @=)) +e 

fe =fu+M—Sfs fu = My (1-13) 
Sn = BX — J) (&— y)=%x-—) 

p=sy pe sy 


This will lead to the block diagram of Figure 1-5. This block diagram is 
equally useful for the purpose of pencil-and-paper analysis of the system. 
However, for the purpose of simulation, it involves “s boxes,” implying time 
differentiation rather than integration. With analog simulation the process 
of differentiation is best avoided, because of the tendency for it to accentuate 
noise difficulties. With digital simulation differentiation is more prone to 
cumulative errors associated with the iterative techniques that must be used, 
as well as leading to convergence difficulties associated with the finite incre- 
ments (of time) necessary with any digital-simulation method. For this 
reason the block diagram of Figure 1-5 is not as well suited for system simu- 
lation as is that of Figure 1-3. 


inputs 
or 
independent 
variables 
(constants 
or 
functions 
of time) 


basic 
dependent 
variable 
of interest 


FIGURE 1-5 


1-6 Configuration of the Analog-Computer Program 


In an electronic analog computer, the only true independent variable of the 
machine is time. Hence it is necessary to relate machine time, t,,, tO the value 
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of the basic independent variable of the problem being simulated. This 
basic variable will not be time in all problems, but in problems of dynamics 
it ordinarily will be. (For example, when using the computer to simulate 
the static bending of a beam, the basic independent variable is distance 
along the beam.) In this Figure 1-1 example, the basic independent variable 
does happen to be time, measured from an arbitrary initial instant defined 
as t = 0, However, there still need not be a 1: 1 relationship between prob- 
lem time, t, and machine time, t,,. Sometimes, various scale conversion 
factors will be employed so that the speed of the simulation process is con- 
venient for the means employed to observe or record the results. Of course, 
there are applications, particularly in control and in training simulators, 
where machine time must correspond to problem time; this is referred to as 
real-time simulation. 

With electronic analog computers, all variables other than the basic 
independent variable are represented as electrical voltages. For example, 
the major dependent variable of interest in this example is the displacement 
y. This will be represented on the machine as a voltage y,, equal to y times 
a scale factor. Similarly, an independent variable of interest other than 
time ¢ is the displacement of the support x. This will also be represented 
by a related voltage, x,,. The scale factors used in this example, relating the 
problem variables to the machine variables, are established by methods to 
be discussed later. By such methods the following scale factors are chosen 
for the example treated here: 


y =0.1y,, cm 
That is, 1 V on the computer will represent 0.1 cm of displacement, where 
Ym is the voltage representing y on the computer. Similarly, 

t=0.017,, sec 


meaning the 0.01 sec of time in the actual problem being simulated will be 
represented by 1.0 sec of computer running time. Completing this scaling 
list, 


y = 20), cm/sec 
x =0.1x,, cm 
x = 20%,, cm/sec 


y= 5000f,, cm/sec? 
f=2f, kg (applicable to f;, f,, fx, and M) 
One of the summing points in Figure 1-3 develops the relation 
Cay) 
Substituting from the above list, there results 
20(%,, — Pm) = 20%,, — 20Y,, 
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or 

Gaon) =m (1-8m) 
Therefore, it is necessary merely to employ a summing amplifier (or “sum- 
mer”), which is capable of adding and/or subtracting, in order to perform 
this operation. The summing symbol in the block diagram of Figure 1-3 
is therefore replaced in the manner shown in Figure 1-6. The triangular shape 
shown is conventionally employed to represent such a summing amplifier. 


y 
Yn 
x becomes 
Xm 


FIGURE 1-6 


The other summing junctions of Figure 1-3 are similarly replaced by 
summing amplifiers, as shown in Figure 1-7. It should be noted in Figure 
1-7 that the constant gravity force, M, or 0.5 kg, becomes represented by a 


Xm 
x becomes 
y, ri 
¥ m 


Int = 9:25 V 
M = 0.5 kg = constant 


Kn 


FIGURE 1-7 


machine voltage of 0.25 V, consistent with the relationship f = 2fy,. This 
constant source of voltage will be obtained from a device called a potentio- 
meter, which can reduce fixed reference voltages available within the computer 
to lower specific values, which might be required in instances such as this. 
The inclusion of such a potentiometer might be shown in the analog-program 
diagram as illustrated in Figure 1-8. 

A potentiometer connection such as that used in Figure 1-8 might 
be used in those analog computers where a 100 V reference supply is avail- 
able. The notation 0.0025 next to the potentiometer symbol (circle) indi- 
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reference supply 
100 V 


0.0025 


FIGURE 1-8 M=0,25 V 


cates that the mechanical setting is such that the output voltage is 0.0025 
times the 100 V available from the reference supply. 

Therefore, such potentiometers are the devices most appropriately 
used when a voltage is to be multiplied by a factor less than unity. They 
also find application for representing the simple multiplications indicated 
by the blocks B, k, and g/M in Figure 1-2. 

From Figure 1-3 or relation (1-2), fy, = B(x — }) = 0.05(% — J). 
Substituting the scale relations f, = 2fy,, etc., in terms of the machine volt- 
ages, this relation becomes 2f;, = 0.05(20X,, — 20},), OF 


Sin = 0.5m — In) (1-2m) 
and the configuration shown in Figure 1-9 is established. 

& - 9» —+[ 5-005 L— becomes (Xp, ~ in} ——-(P}——- 4b, 

0.5 

FIGURE 1-9 

From Figure 1-3 or relation (1-1), f, = k(x — y) = 20% — y); or 

from the scale conversion table, 2f,,, = 20(0.1x,, — 0.1)_), OF 
Sin = 1.0% m — Ym) (1-lm) 


Thus it happens that the potentiometer factor required is unity, and in 
actuality, no potentiometer is required at all. This is shown in Figure 1-10. 


nm — Im) * Se, 


C=) k=20 f, becomes 
FIGURE 1-10 

From Figure 1-3 or relation (1-4), § = (g/M) fe = (980/0.5) fi = 
1960f,,. From the scale conversion table, 5000j,, = 1960(2f,), OF 

J, = 0.784 fv, (1-4m) 


This is shown in Figure 1-11. 
The only remaining blocks to be represented are those involving 
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ty g Y becomes Sp ——{?}—— »,, 
0.784 


FIGURE 1-11 


integration of the 1/s type. For example, from Figure 1-2 or relation (1-5), 
J} = (1/s)j, or » =f Pdt. With the scale conversion factors given, 20.0), 
= f (5000f,,) d(0.01¢,,), or J, = 2.5 [ j,, dt, or 


In = 3m (1-5m) 


where s,, represents the operation d/dt,,. This operation is shown in Figure 
1-12, Note the shape of the symbol used for the electronic integrating ampli- 
fier (or simply integrator). The notation within this symbol, 2.5, relates to 
the same numerical coefficient in relation (1-5m) and sometimes is referred 
to loosely as the integrator gain. It means that this type of amplifier will 
function so that the output will increase at a rate of 2.5 V/sec for every 
volt applied to its input. 


BY Y becomes}, Ym 


FIGURE 1-12 


It happens that practical analog-computer integrators often have a 
limited number of gains that may be utilized (the particular gain obtained 
depending on a choice of input connections or switch positions). In a typical 
case those values might be 1, 2, 3, 10, 20, and 30, none of which corresponds 
to the gain of 2,5 required here. The most practical solution would be to use 
some higher value of gain than is required and then reduce this effective 
gain by the addition of a potentiometer. For example, the modified integrator 
for effecting relation (1-5m) might be as shown in Figure 1-13. 


FIGURE 1-13 


Similarly, relation (1-6), » = (1/s)j, is converted to machine variables 

by the operations y = { jdt, 0.1y,, = { (20J,,) d(0.01t,,). ¥, = 2 [Pm Uys OF 
ee 

Vn = mo" (1-6m) 


and an integrator gain of 2 is required. The block of Figure 1-3 corresponding 
to relation (1-6) is then converted as shown in Figure 1-14. 
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oe 5 Pens ».—p>—. 


FIGURE 1-14 


Employing all the problem-to-machine conversions described above, 
Figure 1-3 may now be changed to an analog-computer-program diagram 
as in Figure 1-15. 


0.05(x — 3) 


independent 
variables 


10 —y) =f; 
‘mn 


FIGURE 1-15 


1-7 Introducing Initial Conditions in the Analog 
Program 
Figure 1-15 is still incomplete in a number of respects: 


1. It does not provide for initial conditions of the basic variables. 
2. It does not provide for the independent variables x and x. 
3. It does not provide for output (i.e., the display of the results). 


The first of these matters will be discussed in this section. 
Since this example constitutes a two-state problem, its response cannot 
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be determined until two boundary conditions are specified. As mentioned 
previously, the two to be used are the initial value of the displacement, y, 
or y(0), and the initial value of the velocity, », or (0). This will determine 
the initial values of the output voltages of the two integrators shown in Figure 
1-5, 

Suppose, for example, that the initial displacement y is 1.0 cm, and the 
initial velocity is zero. The corresponding initial machine values would be 


yq(0) = 29 — 10 


Jn(0) = 0 

All analog computers have some method for establishing the initial 
outputs of integrators, the technique differing considerably from one com- 
puter design to the other. (These techniques will be discussed later.) The 
most common method consists of applying the desired initial-condition volt- 
age to an initial-condition (IC) terminal at the integrator. The integrator 
will then adjust itself to that value of output prior to switching the opera- 
tion of the computer to the operate or compute mode. Hence, in the example 
given, 10 V would be applied to the IC terminal of the integrator that pro- 
duces y,,. First, this voltage must be developed by a potentiometer con- 
nected to the reference supply (unless this required voltage should happen 
to be available). Then, the connection to that integrator would be modified 
as shown in Figure 1-16a. The other, the }-producing integrator, requires 
zero initial voltage. Properly speaking, this is accomplished by grounding 
the IC terminal of that integrator, as shown in Figure 1-16b. With many 
computers, however, simply leaving the IC terminal disconnected will also 
suffice to assure zero initial condition. 


0.1 
reference 
HON 100 V 
Ic 
10y 0.05» 
FIGURE 1-16a FIGURE 1-16b 


1-8 Introducing the Independent Variables 
in the Analog Program 
The description of the problem is not complete until the manner in which 


x and xX vary with time is specified. In different types of problems many 
possibilities exist. x might vary sinusoidally in a random fashion or follow 
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any arbitrary pattern, perhaps only once or perhaps repetitively. One of 
the simplest cases is when x varies in a ramp fashion, as shown in Figure 
1-17a. Its time derivative x would then be a step function, as shown in Figure 
1-17b. [Note that in this problem the computer cannot handle the case of 
x itself being a step function, because then * would be an impulse with an 
infinite amplitude for an infinitesimal time. This, however, is not a weak- 
ness of the computer; in the actual physical problem, x could not be a step 
function because this would imply an infinite force available to overcome 
the damping force f, = B(x — }).] 
= x 


FIGURE 1-17a FIGURE 1-17b 


The simple example of x being such a ramp function will be considered 
here. Means are also available within analog computers for producing other 
functions of time as independent variables, but they are more complicated 
and their discussion will be deferred. 

Let it be supposed that x varies as such a ramp function with a slope 
of 100 cm/sec or 


x = 100ru(t) cm (1-14) 
Hence 
x = 100u(t) (1-15) 
and of course 
fe f t= 43 with x(0) =0 (1-16) 
o 


In machine language the corresponding values of x, and xX,, are substituted 
for x and x from the scaling relationships already listed; then 


% = 20%,, = 100u(t) 


or 
X», = Su(t) Vv (1-15m) 
and 
x =x, =f edt = [7 m(20%,,) 4(0.014,) = 0.2 f° Xp, dt, 
i) 0 ) 
or 


(1-16m) 
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The step function x can be produced by simply closing a switch at 
time f,, = 0. This switch applies a voltage of x,, = 5 V to the X,, terminals, 
The 5V signal is produced by a potentiometer connected to the 100 V 
reference supply and set for a factor of 0.05. The program for producing 
x and % therefore appears as shown in Figure 1-18. 


0.05 0.05% 
referees £7 =101058 
f=0' 
to analog 
we of system 
Ic 
Xm = 10x 


FIGURE 1-18 


1-9 Provision for Output Display with 
the Analog Program 


In a program of this sort, the outputs of interest might be x, x,y, 3, F, 
and f,. Various methods of output display could be used. In more elaborate 
installations, the solution could be interrupted at specified time intervals 
(machine time could be brought to a halt) by putting the computer in a hold 
mode; the voltages corresponding to these quantities could then be read by 
a digital voltmeter and tabulated by a digital printer. A different technique 
would be to present displays of the output response plotted versus time on 
a cathode-ray oscilloscope. This is accomplished by utilizing such a time 
scale that the problem is solved in lengths of machine time on the order of 
milliseconds; this solution is repeated at a rapid rate by repetitive switching 
means that periodically place the computer in alternate operate and initial 
condition (also called reset) modes. If the linear-sweep rate of the cathode- 
ray oscilloscope is synchronized with such switching periods, time plots of 
the response can be observed. Either of these two methods would require 
radically different time-scale factors than the one chosen here (t = 0.014,,). 
These methods of output display will be discussed in more detail later, 
The method of output display to be considered here, involving a record- 
ing oscillograph, is one of the most popular. If the oscillograph available 
has at least six channels, then all the output voltages corresponding to the 
six quantities listed above, x,,, ms ¥mr Jn» Bms and Scns May be recorded as 
plotted functions of time. This procedure simply requires connecting these 
output voltages to the associated input channels of the oscillograph. The 
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gains of the internal amplifiers for each oscillograph channel are adjusted 
separately, generally on a trial-and-error basis, so that each output will be 
displayed with the maximum possible scale deflection not exceeding the 
range of the record. The paper speed is adjusted to give a record of reason- 
able length (in a problem such as this usually of no more than 13 cm to 
permit posting in a notebook) during the time of interest. In this example, 
all transient phenomena will have died out in about 0.05 sec of problem time, 
corresponding to 5 sec of machine time. It can be seen that the execution 


| time of an analog computer is almost negligible compared with the time 
required to establish the programming, and that repeated runs can be made 
readily with no significant additional cost. For this reason, trial-and-error 
adjustments constitute an acceptable procedure. (This also applies to trial- 
and-error adjustment of scale factors used in problem-to-machine con- 


version.) This advantage will not apply as well with digital simulation since 
the execution time normally is longer and more expensive. 
[It might appear trivial to mention the following precaution here except 
\ for the many useless oscillograph records that have been obtained because 
it was ignored. After the oscillograph gain factors are adjusted satisfactorily, 
it is important to record these factors for each channel (e.g., the volts cor- 
responding to full-scale deflection). It is then important that ordinate scales 
be added immediately after each record is run, with the problem—machine 
scale factors taken into account. This precaution also applies to recording 
paper speed, except that in many cases a timing marker will be utilized that 
produces a pip once every second (machine time). When this is the case, 
a record of the paper speed used is not required.] 


1-10 Actual Computation and Results 


There is no intention here to go into the details of computer operation or 
construction. There will be some brief mention of this later in regard to those 
details necessary to understand the computer's limitations and to recognize 
causes of computer malfunction. From the standpoint of applying a program, 
Y as in this example, it is merely necessary to establish the interconnections 
between computer elements, as shown in Figure 1-19. The procedure for 
doing so depends upon the computer used, but, in any event, no electronic- 
technician ability is required. After this is done, the potentiometers employed 
are all set to the values indicated in the program. Then the computer-mode 
switch is thrown to the IC (initial condition) or reset mode so that the out- 
puts of all integrators will be brought to their desired initial values. This 
mode must be maintained for about | sec for normal operation (and less 
for the repetitive form of operation described previously with oscilloscope 
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display of output). Then the mode switch is thrown to the operate or compute 
position and the results are recorded on an oscillograph. 

In this particular problem, some of the voltages (specifically x,, and 
Ym) will exceed the voltage range of the computer after a certain time has 
elapsed; subsequent results will be erroneous and should be ignored. This 
overload condition will be indicated by some sort of warning signal but 
(in any properly designed computer) does not damage the equipment. The 
scale factors listed previously were selected for a computer designed for opera- 
tion within the ranges of —100 to +100 V, and such an overload condi- 
tion would not occur until the transient portion of the response had died 
out and only the steady-state response remained; hence all pertinent infor- 
mation related to the problem would have been obtained before this con- 
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FIGURE 1-20 
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dition arose, Figure 1-20 is a diagram of the specific results obtained for this 
example. 


1-11 Modification of the Program with Inverting 
Types of Amplifiers 


The program shown in Figure 1-19 is based on the premise that summers 
and integrators are available that can accept inputs and provide gains in 
either the positive or negative sense by either positioning a sign switch or 
by an appropriate input connection, Such provisions are available in a 
minority of the analog computers used in practice. 

More often, however, the amplifiers used for summing or integrating 
do not present such an algebraic choice; their inputs are always changed in 
algebraic sign (i.e., inverted) when the corresponding output appears. This 
is not as serious a limitation as it might first seem, as a negative signal can 
always be introduced in the positive sense, when needed, by applying it 
through an inverter (i.e., an amplifier of unity gain that merely changes the 
algebraic sign). The symbol for an inverter is shown in Figure 1-21. Con- 
sequently, programs will normally include more amplifiers when only 
inverting types of amplifiers are available because of needs that may arise 
for algebraic-sign conversion. This disadvantage is said to be overcome by 
the fact that inverting types of amplifiers (summers and integrators) are 
less expensive and complicated than those that permit a choice of sign. 


(In computers using such 


inverting amplifiers, the 
negative sign is implied 
and not normally included 


in the diagram) FIGURE 1-21 


In any event, when a computer having such sign-inverting amplifiers 
is being used, the program of Figure 1-19 will require some modification. 
The number of inverting amplifiers needed can be minimized by permitting 
some of the variables of interest to appear in their negative sense. Figure 
1-22 shows such a modification. It should be noted that it was necessary to 
add four inverters. [Figure 1-22 represents the actual program employed to 
obtain the results shown in Figure 1-20. It should also be noted that all 
amplifiers (summers, integrators, and inverters) and all potentiometers have 
been numbered. This was for identification purposes. These numbers have 
significance only in regard to the particular computer employed to obtain 
these results.] 


@Z-b 3YNdI4 


*ad A} SUNJOAUT Jo are (SIAUIUINS PUR sIOJRIZOIUT) SIOLdwe [Ty 


22 Fundamental Simulation Techniques: An Example Chap. 1 


1-12 Establishing the Flow Diagram 
for Digital Simulation 


Discussions regarding digital simulation programs will be conducted here 
on a general basis, in terms of flow diagrams, and without regard to any 
particular computer language such as Fortran or Algol. This policy is being 
followed because of the great rapidity with which these languages are being 
modified. However, for this particular example only, an example will be given 
in Appendix 1A of the Fortran IV program used to obtain the results de- 
scribed. 

It might be mentioned at this point that some scientifically oriented 
computer language is usually recommended for the digital simulation of 
dynamic systems. Rarely is the use of direct machine language recommended. 
The latter not only requires a more specialized knowledge of computer 
programming than the average engineer is likely to have, and a more specific 
knowledge of the peculiarities of a particular computer, but also has the 
disadvantage of poorer error diagnosis; programming errors would be more 
likely to occur. Machine language is justified only when the same program 
is to be employed so frequently, without modification, that the more efficient 
utilization of the computer facilities that it might afford overcomes the other 
disadvantages. 

A flow diagram may look somewhat similar to a block diagram but 
is a very different sort of thing. It establishes not the flow of cause and effect, 
but the actual time sequence of the computer operations. 

The basic flow-diagram symbols used here will include the rhombus, 
employed to indicate decision operations. One example is shown in Figure 
1-23, Another example is shown in Figure 1-24 where the variable is a logical 
(Boolean) quantity which is either true (or = 1) or false (or = 0). 

Another symbol used will be the inverted trapezoid, to indicate input 
or output operations. Examples of this are shown in Figure 1-25. 


meaning: if x <y, go to (a) 
x =y, go to (b) 
x>y, go to(c) 


(a) (b) (c) 


FIGURE 1-23 
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false true 
meaning: if z is false or (0), 
then go to (a); 
zis true or (1), 
then go to (b) 
a) (b 


( ) 


FIGURE 1-24 


Seance 


FIGURE 1-25 


Often the computer program will require format instructions along 
with such input or output statements; these will not be discussed here. 

The most common symbol will be a simple rectangle, used for ordinary 
arithmetic operations, as shown in Figure 1-26. The significance of the equal 


yrytx 


FIGURE 1-26 


sign in an arithmetic statement should be noted. It does not mean equality 
in the algebraic sense (the digital computer cannot do algebra directly), 
but rather the replacement of the quantity assigned to a given variable. 
For example, y = y + x means that the old value of y is to be replaced by 
a new one equal to the old value plus x. The statement y = ay instructs the 
computer to replace the old value of y by a new value equal to a times the 
old. 

The computer will handle differently those variables that are designated 
as integers (fixed-point variables) and those that are real (floating-point 
variables). For example, if x and y are integers and x = 6 while y = 4, then 
x/y would be computed as 1, the correct quotient when truncated to the 
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next lower integer. But if x and y are real with x = 6.0 and y = 4.0, then 
x/y will be computed as 1.5. The exponential operation x’, where, say, y 
is an integer equal to 3, will be executed by the multiplication x-x+x; if 
y is real and equals 3.0, it will be executed as x” = log”! (3 log x). Both pro- 
cedures produce the same result but involve different operations and different 
execution times. In this example the second procedure would be a slower 
one, but if y were a much higher integer, it would be a faster one. Naturally, 
the second procedure is necessary when y is not an integer. 

There are many more distinctions between the manner in which the 
computer handles real and integer quantities. These ordinarily will be known 
by anyone who has had elementary programming experience. Most variables 
to be discussed in the simulation programs here must necessarily be real, 
since they represent analog-type quantities for the most part; when a variable 
used in a computation is to be treated as an integer, this will be stated. 

Depending on the programming language used, the mathematical 
symbols employed here may require modification before they can be used 
in a computer source program. Computer compilers in most Western coun- 
tries can normally accept only letters from the Roman alphabet as symbols 
for variables; hence Greek symbols such as A will require conversion, Never- 
theless, the flow diagrams used here to illustrate simulation methods will 
employ the conventional mathematical symbols, it being understood that 
these will be modified as necessary in the source program. 

Other restrictions might also apply regarding the choice of symbols 
used in the source program. Some languages restrict the usage of the first 
alphabetical character of a symbol in the sense that symbols beginning with 
alphabetical characters from I to N must apply to quantities that are only 
integers, while symbols starting with some other letter must apply to real, or 
floating-point, quantities. In the more modern languages the programmer may 
take exception to this restriction, For that reason the restriction will not be 
observed when presenting flow diagrams here. For example, the symbol 
M will be used to designate the mass in the example being treated, even though 
the quantity, mass, must be represented by a real number, It is assumed that 
a user employing a language in which this restriction applies (as Fortran 
I) will make the necessary modification, such as by changing the symbol 
to AM. 

The second restriction applies to the length of symbols. Symbols such 
as CALIBRATE and FIRSTCALL will be employed here even though some 
languages will not permit symbol lengths in excess of six characters. It is 
assumed, again, that the user will make the necessary modifications when 
this is necessary. 

As all simulation programs of the type with which we are concerned 
will involve integration with respect to some basic independent variable, 
and as digital integration normally must be performed in a stepwise, or 
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iterative manner, it is necessary to select an iteration interval to be designated 
(when time is the independent variable) as Af. It will be necessary to recom- 
pute all variables at every time increment Ar. (Some exceptions to this will 
be discussed in Chapter 3.) This procedure will be discussed in more detail 
in Chapter 3, and it will be shown that exact results of integration can be 
obtained only as At — dt —» 0. Hence accuracy of simulation improves 
with decreasing size of Ar; execution time, however, will increase by the same 
proportion. Therefore, one of the major problems associated with digital 
simulation will be the selection of an appropriate interval At. This selection 
will be done here on a trial-and-error basis, but a more quantitative and 
analytic approach to this problem of sampling error will be considered later. 

The digital-computer flow diagram indicates the time sequence of the 
operations to be performed. Within one given integration interval, the follow- 
ing operations are required: 


(a) The outputs of all integrators will be known for the present time 
instant from the integration operations performed over the preced- 
ing time interval. 

(b) The new values of the time-dependent inputs to the system (e.g., 
x and x in the example) are established. 

(c) The block diagram is traced to establish the inputs to all integrators 
as they will now apply at the present time instant. This is a purely 
arithmetic operation involving the summing junctions and transfer 
constants (such as B, k, g/M). 

(d) Time is updated (i.e., ¢ is replaced as t + Af). 

(e) One iteration of numerical integration is performed so that the 
new integrator outputs (e.g., y and j in the example) applicable 
at the new time instant may be established. 


The operation then returns to step (a). This is illustrated in Figure 1-27. 
Each traversal of this loop advances time by the amount At. 

The procedure described, which starts with the block diagram and 
establishes the desired sequence of digital operations (as represented by the 
flow diagram), is known as sorting. A user acquainted with the principles 
described here may readily do his own sorting when preparing the program. 
For the benefit of those who lack this knowledge, macroscopic simulation 
programs, such as MIDAS, MIMIC, and IBM-CSMP, will permit one 
unfamiliar with digital procedures to load his own program on a computer, 
starting only with the block diagram and following various specific instruc- 
tions [1, 2]. 

Figure 1-28 is a flow diagram showing the application of the general 
procedure of Figure 1-27 to the specific problem treated as an example in 
this chapter. It should be noted that step (a) is not actually executed, except 


Integrator outputs normally 
provided by the computation 
during the preceding interval 


Determine new values of the 
time-dependent variables 
and parameters 


this may involve time- 
function generation, in- 
terpolation, or implicit 
methods 


this involves tracing 
through all summing 
junctions and para- 
meter blocks 


Update time 


numerical integration 
by one of a number of 
methods available. (see Chap. 3) 


Determine what the new inte- 
grator outputs will be at 
the end of the Ar interval 


FIGURE 1-27 


(a) 


CALL XFUNCTION(CALIBRATE, t, x, X) find yand) Skee 
present time instant 


fy = BG —-Y) 
Sy =k —y) 
¥ =(8/M) fy +f, -—) 


the sequence of these first two 
operations is unimportant 


updating time 


numerical integration by 
the rectangular method; 
the sequence of these two 
operations is important 


FIGURE 1-28 
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as a transfer operation returning the iterative loop. Step (b) is handled by a 
procedure or subroutine that can be prepared as an independent program. 
This would permit a number of input time functions to be used by changing 
the choice of subroutine, called here XFUNCTION, without requiring alter- 
ations of the main program. 

It should be noted that the actual integration operation, designated 
by 1/s in two blocks of Figure 1-3, has now been replaced by a rectangular 
integration operation, illustrated in Figure 1-29. As At becomes sufficiently 
small, the approximation error becomes insignificant. Other integration tech- 
niques discussed later will permit the size of the integration interval At to 
be increased without impairing the integration accuracy. 


yp 


area being omitted by the 


~——_—— ‘ 
rectangular approximation 


cross-hatched area is considered 
to be Ay=y Ar 


— 


FIGURE 1-29 


Referring to Figure 1-28, it should be noted that if the two operations 
of step (e) had been interchanged, the integration for obtaining Ay would 
have been based on the future, rather than past, value of the integrand ). 
This is not necessarily less desirable, but it does represent a different method 
of numerical integration. 


1-13 Additions to Provide a Workable Program 


The program development shown in Figure 1-28 is incomplete, as was the 
preliminary analog program of Figure 1-15, for the following reasons: 


1. It does not provide for initial output values of the integrators. 

2. The subroutine that provides the values of x and x must still be 
furnished. 

3. It does not provide for the display of output. 
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Furthermore, 


4. It does not provide for establishing the values of constants or 
parameters such as B, k, or M (corresponding to setting the poten- 
tiometers in the analog program). 

5. It does not provide for the termination of a run. 


The logical place to enter the program for the purpose of starting the 
simulation and to overcome the first deficiency is at the point called (a) in 
Figures 1-27 and 1-28. At that point the initial values of all integrator values 
must be furnished. It is also necessary to designate the initial value of time 
at this point—most frequently by the operation t = 0. 

Deficiency 2 is handled by the subroutine XFUNCTION, to be discussed 
further. The logical place to branch from the program temporarily for the 
purpose of listing (or storing) output results is after step (c), since then the 
new values of all variables of interest will have been calculated. 

An arbitrary terminology distinction will be made between what are 
called constants and what are called parameters that does not correspond 
to normal mathematical usage. As some of these quantities may maintain the 
same value from one run to another, these will be designated constants. 
Others, which may be changed from one run to the other, will be designated 
parameters. Provisions will be made for reading in parameters more than 
once; constants will be read in only once, at the beginning of the program. 

Deficiency 5 related to the necessity of terminating a run, either when 
t has reached some particular value or when some other stipulated criterion 
has been met. In the example, it will be assumed that the former criterion 
applies and that the run is to be terminated when ¢ equals or exceeds a speci- 
fic value designated as /,,,,. Such tests for termination will normally be 
made only after a listing (or recording) of output results has been executed. 

Figure 1-30 is a flow diagram that describes the complete program 
(except for such input subroutines as XFUNCTION) with the previously 
described deficiencies removed. It is merely an extension of Figure 1-27. 
It should be noted that the first step consists of reading in all constants and 
instructions. The latter refers to such things as the prescribed size of the 
interval, At, the time interval between printout of results, At,, and the in- 
tended duration of the run (in terms of problem, not machine time), fn... 

Figure 1-31 is a flow diagram that follows the general scheme of Figure 
1-30 but applies specifically to the example problem being treated in this 
chapter. It is assumed here that a number of runs are intended for various 
trial values of the damping constant B; hence B is considered as a parameter. 
It is read in again every time the program returns to the second step (read- 
in parameters). It is also necessary to state at this time whether still another 
run is to follow. This is done by reading in, along with the value of B, the 
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logical variable, LAST. If LAST is designated as true, or 1, this indicates 
that this is the last run and that the program should terminate at its com- 
pletion. Otherwise, LAST will be read in as zero or false and the program will 
return to the parameter-read statement again after the run is completed. 
In Figure 1-31, the details of the printout decision and execution, and the 
termination decision, are not shown. These details are shown in Figure 1-32. 

It would have been possible to arrange this printout decision, execu- 
tion, and termination decision as a subroutine; this is pretty much a matter 
of programmer preference. It should be noted that the variable ¢,, meaning 
time to print, controls the printout decision. Normally, ¢, would be set to 
zero initially so that a printout at t = 0 would be obtained. Actually, in 
Figure 1-32, it should be noted that f, is set initially to —At/2. This has the 
same effect, but often is preferable because it eliminates the danger of round- 
off errors causing the printout to occur after (when t = Af) the first iteration. 

The generation of the time-dependent inputs x and x by the subroutine 
described as XFUNCTION is still to be described. As in the analog example, 


to statement, is it time to statement 
t=r+At to print “Read B, etc.” 
in Figure 1-31 output? in Figure 1-31 


Print ¢ and list of variables of interest 


is it time 
to end run? 
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; yes 
updating 
time to print 
is this 
last run? 


true false 


continue run, (or LAST = 1) (or LAST = 0) 


FIGURE 1-32 
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the simple case of x(t) being a ramp function will be used for illustration. 
The subroutine then becomes so absurdly simple that the question might 
arise as to why a subroutine is necessary: Why not handle it by a few simple 
statements in the main program? The answer is, of course, the desire for 
flexibility. Other inputs might also be considered and it would be more 
convenient to change to a new subroutine than to alter the main program. 
For example, x(t) or x(¢) might be generated from tabulated data with inter- 
polation procedures to provide intermediate points. The ramp-generation 
subroutine used for this example is shown in Figure 1-33. It should be noted 
that provisions are made for printing the information that the input is a 
ramp with a slope of r, with the value of r also printed. 


SUBROUTINE XFUNCTION (CALIBRATE, 
xan 


1 or true 


0 or false 


CALIBRATE 
4 calibrate before 
iterations begin 
executed 
every 


iteration establishing 


x(t) 


Print ‘tx is a ramp function 
with slope of”; print r 


RETURN 


2% established 
once, at be- 
ginning of 
program 


RETURN 


FIGURE 1-33 


Data cards or other sources of input will be required for such a pro- 
gram as follows: 


1. The values of the constants, k and M. 

2. The value of the parameters, in this case B. Also, the values of 
At, the print interval Ar,, the time range of the run f,,,,, and the 
logical information as to whether this run is to be the last (LAST 
is true or 1) or whether another run is to follow (LAST is false or 
zero). 

3. The numerical characteristics of the x function. When the simple 
ramp subroutine is used, as shown here, this would simply be the 
slope of the ramp function r in cm/sec. 
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4. The initial values of y and } in cm and cm/sec. 


Card | is used only once, at the beginning of the program; cards 2 to 4 must 
be fed into the program for each run. 

Appendix 1A shows a Fortran IV version of the program represented 
by these flow diagrams. 


1-14 Results of the Digital Simulation Program 


The program shown in Figures 1-31 and 1-32, along with the subroutine of 
Figure 1-33, was executed on an IBM 360, Model 65 computer after being 
compiled by a Fortran IV compiler. The conditions represented were iden- 
tical with those of the analog program of Figure 1-22, and results identical 
with those plotted in Figure 1-20 should be expected. The duration of prob- 
lem time chosen was 0.100 sec (t,,, = 0.100) with printouts of response 
obtained every 0.002 sec. This is a sufficient time range for this particular 
problem, since the transient portion of the response will have essentially 
died out by the end of this period. 

The results of a typical run employing such a program are shown 
in Figure 1-34. (There, owing to printer limitations, YDD denotes j and YD 
indicates yj.) The iteration interval At chosen was 0.0002 sec; hence 500 
iterations were necessary to cover the time range. The execution time of the 
iterative portion of the program, including the output operation of trans- 
ferring output data for later off-line printout, was 16 sec with this particular 
computer. The program shown in Appendix 1A was used, with statements 
added to accomplish execution-time measurement. 

It is not fair, however, to include output execution time when com- 
paring various methods of simulation. Hence, for a more indicative measure- 
ment of execution time, the program shown in Appendix 1A was modified 
to place the output data in a storage array for later printout after the iterative 
cycles are completed. The execution time then noted, for the iterative portion 
of the program only, was 3.6 sec. As this represented a problem time of 
0.100 sec, it may be seen that even with the relatively fast computer employed 
nothing approaching real-time simulation was obtained. 

The problem used as an example in this chapter is, of course, readily 
solved analytically; hence the percentage of computation error may be 
established directly. Percentage of error is defined as 


100 (computed value) — (correct value) 
range of the variable 
On this basis and with the At of 0.0002 sec used to obtain the results tabulated 
in Figure 1-34, the computed values of the variables of interest have maxi- 
mum errors as follows during the course of the run: 
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x 

CM 
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0.074 7.400 1154. 94.41 7.359 0.81 
0.076 7.600 1267. 96.86 7.550 0.99 
0.078 7.800 1180. 99.34 7.746 TI07 
0.080 8.000 939. 101.51 7.947 1.05 
0.082 8.200 605. 103.09 8.152 0.96 
0.084 8.400 259. 103.97 8.359 0.82 
0.086 8.600 -100. 104.14 8.567 0.66 
0.088 8.800 -368. 103.68 8.775 0.50 
0.090 9.000 -539. 102.78 8.981 0.36 
0.092 9.200 -605. 101.62 9.186 0.27 
0.094 9.400 -573. 100.43 9.388 0.23 
0.096 9.600 -465. 99.37 9.588 0.23 
0.098 9.800 -308. 98.57 9.786 O27 
0.100 97999 -134. 98.11 9.983 0.54 
FIGURE 1-34 


displacement, y OL, 


velocity, 0.7% 
acceleration, j Bes 
force, f, 1.0% 


Whether such degrees of accuracy are adequate will depend upon the 
application of the simulation procedure. Quite possibly this degree of accu- 
racy is better than is really required in view of the approximation errors when 
establishing the mathematical description of the problem, such as the 
neglecting of nonlinear effects and of the distributed mass and resilience of 
the spring (as discussed in Chapter 10). It would also be questionable, in 
most practice, whether the parameters M, k, and especially B are really 
known more closely than a few per cent. 

In any event, the computation error caused by finite iterations (i.e., 
the sampling error) can always be improved by reducing the size of the 
iteration interval. This will, of course, be at the cost of additional execution 
time. A more practical way for both improving accuracy and reducing the 
required execution time is by employing one of the more sophisticated 
methods of numerical integration described in Chapter 3. The relatively 
crude method described in this chapter, rectangular integration, was intro- 
duced simply because it is the easiest to explain. 

Frequently, a graphical description of the output is desired, as in 
Figure 1-20, rather than the tabulated digital results shown in Figure 1-34. 
In an increasing number of digital-computer installations, plotters are 
available that can convert the output to a specified plotted form; this usually 
is an off-line operation. Another alternative consists of the relatively crude 
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output plots that can be executed by the printer. Program modules for this 
purpose are available in many packaged simulation programs such as CSMP. 
However, it is relatively simple for the user who has some elementary pro- 
gramming experience to prepare a subroutine that will produce such an 
output plot. Such crude printed plots are especially useful in that they permit 
faster inspection of the output results than is possible by a visual scanning 
of tabulated output data. 


1-15 Relative Advantages of Analog 
and Digital Simulation 


It is difficult to reach any general conclusions concerning the relative advan- 
tages of analog and digital simulation from the simple problem used in this 
chapter. Because of the simplicity of the problem, no unusual programming 
difficulties are encountered with either method. The analog simulation will 
prove to be faster, but whether this is a significant advantage will depend 
upon the application of the simulation procedure. If real-time simulation is 
required, particularly of a problem involving more dynamics, analog tech- 
niques of integration may be necessary to meet the execution-speed require- 
ments. On the other hand, discontinuous-type problems requiring extensive 
logic may require digital procedures. In a number of practical simulation 
problems, the only really satisfactory answer may be the use of a hybrid 
computer that possesses both analog and digital features, These are discussed 
later. 

When determining whether an analog or digital approach is to be 
employed in a given simulation application, the question of relative cost 
will always be important. Determination of the expenses involved will include 
not only the equipment cost and the cost of the operating time, but also the 
cost of the time of the associated personnel. Urgency of the results also may 
be a factor. Analog simulation is fast, but considerable time may have been 
spent preparing the program and making the necessary interconnections. 
Digital programming also requires program-preparation time, which, depend- 
ing on the problem, the programmer's knowledge and experience, and the 
possibility of using standard program modules, may be greater or less than 
that required to get the analog program working. Prepackaged simulation 
programs, such as CSMP, will shorten the programming time and reduce 
the amount of knowledge and skill required of the programmer (however, 
only after he has learned the special language that is employed). It may 
result in less flexibility and possibly longer execution times than a program 
prepared specifically for a given simulation problem. 

When a simulation problem is to be prepared that will be subject to 
many trial-and-error parameter adjustments that cannot be foreseen at the 
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outset, analog procedures may be preferred because the procedure of reset- 
ting a coefficient potentiometer is generally simpler and less expensive than 
calling for a repeat run with revised data. The extent to which this is the case 
will depend upon the convenience of operation of the digital-computer 
facility. One that has a turn-around time (time elapsed from when the pro- 
gram is submitted to when the results are received) of, say, 24 hours certainly 
will encourage the use of analog simulation instead. As more and more 
digital-computer facilities adopt such schemes as remote consoles and time 
sharing, the turn-around time decrease to the point where analog computers 
lose much of this advantage. Furthermore, some parameter changes may 
necessitate rescaling when analog computers are used. This difficulty does 
not occur with digital simulation. 

Tn summary, when a choice between analog and digital simulation is 
to be made, no specific rules can be formulated. The answer will depend upon 
the form of the simulation problem, the use to which the simulation model 
is to be put, the type of analog and digital equipment available, and the 
relative ease of access to each facility. 


Suggested Problems 


Both analog and digital programs should be prepared for the following 
simulation problems employing techniques shown in this chapter. If the 
equipment is available, it is suggested that the resulting programs be tested 
by actual computer runs with proper provisions made for the handling of 
input and output data. (Note: Suggested analog-computer scaling factors 
are based on using a computer of 100 V range. If a 10 V computer is used, 
all machine variables should, of course, be only one tenth as great.) 


1-1. Five hundred dollars invested in a certain type of bond becomes worth 

$1000 10 years later. The applicable compound interest rate is to be deter- 

mined by trial-and-error simulation with different rates. (Later, when boun- 

dary-value problems are discussed, techniques for eliminating the trial-and- 

error procedure will be introduced.) 

(a) Develop an analog-computer program to represent this problem and 
to find R, the rate of interest, based on the assumption that interest is 
compounded continuously. The following scale factors are suggested: 


rate R is a potentiometer setting to be adjusted by trial 
and error 

principal P =10P,, dollars, where P,, is the machine variable 
in volts 

time t=t,, years, where ¢,, is machine time in seconds 


(b) Develop a digital program to simulate the same situation as in (a). 
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(c) Modify the program of (b) to represent the interest being compounded 
quarterly. (Note: To handle this with an analog computer would require 
methods beyond the scope of this chapter’s discussion.) 


1-2. Two streams, A and B, of dissolved chemical flow continuously into 
a stirred tank and react almost immediately, producing 400 Btu of heat 
per pound of the solution A. The result is drawn off as stream C. The solu- 
tion is cooled in the tank by means of cooling coils containing water at a 
temperature of 6,°F; presumably the rate of coolant flow is fast enough so 
that there will be negligible rise in this cooling-water temperature. The follow- 
ing numerical values are given: 

rate of flow of A is F,, = 500 lb/hr 

rate of flow of Bis F, = 800 lb/hr 

rate of flow of C if F, = 1300 lb/hr 

temperature of A is 0, = 75°F 

temperature of B is 9, = 85°F 

temperature of C is 8,—variable 

temperature of coolant is 0, = 60°F 

specific heats of A, B, and C are c, = | 

6, is initially 60°F. 

conductivity of the cooling-tube walls conducting heat from the tank 

solution to the coolant is G = 10,000 Btu/hr/°F 

solution stored in tank is W, where, at t =0, W(0) = 3000 lb 
Prepare both analog- and digital-computer programs that will indicate 8, as 
a function of time. For the analog program, the following scale factors are 
suggested: 

heat flows: R = 2500R,, Btu/hr, where R,, is corresponding 

machine volts 
temperature: 0 =0,,°F 
time: t=0.1¢,, hr 


1-3. Figure P1-3 is a schematic diagram of an electronically controlled 
variable-speed drive capable of reversal in direction. (With additional equip- 
ment, it can be made a servomechanism capable of precise control of angular 
position of the load.) The pertinent mathematical relations describing its 
performance are 
generator field 

current relation: 


(R, +R, + L,s)ip =e, V (i, in amperes) 
generated voltage: 
e, =k,i, Vv 
terminal voltage: motor and generator armature 
VSep— Ra Vv inductance negligible 


motor back-emf: 
er =V— Ri Me 
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P| 


constant-speed 
drive field with constant 
excitation 


FIGURE P1-3 


motor speed: 


@, =k,e, tad/sec A 
developed torque: assumes constant magnetic flux 

Q, =kgi kg-cm 
torque at gearing: 

2, = 2, — J,sa, kg-cm _ neglects motor friction 
gear output speed: 

@,=@,/r rad/sec neglects gear backlash 
gear output torque: 

2, =rQ, kg-cm _ neglects gear friction losses 
load inertia effect: 

0, =J,50, kg-cm _ neglects load friction 


(Hint: The last four relations may be combined to obtain one first-order 
differential equation.) Numerically, 
R, = 2000Q (effective source resistance) 


R, = 5002 
L, =100H 
k, = 4000 V/A 
R, =1.09 
R, =1.02 


k,, = 0.5 (rad/sec)/V 
ko = 20.4 kg-cm/A 
J, = 0.8 kg-cm/(rad/sec*) 
r = SO (gear ratio) 
J, = 2000 kg-cm/(rad/sec?) 
(a) Prepare an analog-computer program to simulate the variation of 
i, V, @,, and @, as functions of time when e, is some prescribed function 
of time. Observe and record results for specifically: e, = 100u(t) V 
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(100 V step function) with initial conditions of i,0) =V(0) = w,(0) 
= w,(0) = 0. Suggested scaling is 


626, Vv 
i, =10°7,, A 
e, = 4e,, Mf 
V =4P,, Vv 
e, = 4e,, Vv 
t=2i, A 


@, = 2.00,, 

@, = 0.04a,,, 

Q, = 500,, 

0, = 500,, 

0, = 25000, 
t= 0.1f 


rad/sec 
rad/sec 
kg-cm 
kg-cm 
kg-cm 
sec 


(b) Prepare a corresponding digital-computer program including appro- 
priate input and output statements and execute for the same specific 
e,(t) example as in (a) with a At adequate for 1 per cent accuracy. 
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Appendix 1A 


C SIMULATION OF SPRING-MASS SYSTEM - CHAPTER 1 
1EXAMPLE 
REAL K,M 
LOGICAL CAL, LAST 

1 -READ 100,K,M 
PRINT 101,K,M 
2 READ 103,B,DT,DTP,TMAX, LAST 

PRINT 104,B 
PRINT 105,DT 
CAL=. TRUE. 
CALL XFUNC(CAL,T,X,XD) 
CAL=. FALSE. 
GOVERM-980./M 
T=0. 
TP=-. 5#DT 
TMAX=TMAX-.5xDT 
READ 100,Y,YD 

6 PRINTING LEGEND FOR OUTPUT LIST 
PRINT 102 
PRINT 106 
PRINT 107 

c ITERATIVE PROGRAM BEGINS 

3 CALL XFUNC(CAL,T,X,XD) 
FB=(XD-YD)#B 
FK=(X-Y¥)#K 
YDD=GOVERM#(FB+FK-M) 

10) PRINTOUT DECISION 


a 
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IF(T.LT.TP) GO TO 5 
PRINT 108,T,X,YDD,YD,Y,FK 
TERMINATION DECISION 
IF(T.LT.TMAX) GO TO 4 
IF(LAST) STOP 

GO TO 2 

TP=TP+DTP 

T=T+DT 

RECTANGULAR INTEGRATION 
Y=Y+YD#DT 

YD=YD+YDD#DT 

GO TO 3 


100 FORMAT(2F10.3) 


1F10.3,3H KG) 


102 FORMAT(1H ) 
103 FORMAT(F10.3,F10.5,2F10.3,12) 
104 FORMAT(26X,2HB-,F10.3,10H KG/CM/SEC) 


1SECS ) 


Chap. 1 


FORMAT(1H1,20X,2HK=,F10.3,6H KG/CM,5X,2HM-, 


FORMAT(20X,23HITERATION INTERVAL, DT=,F10.5,5H 


106 FORMAT(16X,4HTIME,7X,1HX,7X,3HYDD, 8X,2HYD, 9X, 


11HY , 8X, 2HFK ) 


107 FORMAT(16X,4HSECS,6X,2HCM, 5X, 7HCM/SEC2, 4x, 


108 FORMAT(10X,2F10.3,F10.0,F10.2,F10.3,F10.2) 


ak 


16HCM/SEC, 6X, 2HCM, 8X, 12HKG ) 


END 
FIGURE 1A-1 


RAMP FUNCTION SUBROUTINE 
SUBROUTINE XFUNC(CAL,T,X,XD) 
LOGICAL CAL 

IF(CAL) GO TO 1 

X=R#T 

RETURN 

READ 300,R 


300 FORMAT(F10.3) 


PRINT 301,R 


301 FORMAT(15X,32HX IS RAMP FUNCTION WITH SLOPE OF, 


1F10.3,7H CM/SEC 
XD=R 

RETURN 

END 


FIGURE 1A-2 


Basic Principles 
of Analog Computers 


2-1 General Comments 


Routine programming and operation of general-purpose analog computers 
is possible with modern equipment simply by following the manufacturer’s 
instructions. Then no electronic knowledge is required. There is, however, 
value in the user’s having some appreciation of the simpler electronic prin- 
ciples that are involved. He will then have a greater understanding of both 
the limitations and potentialities of these devices. This will permit more 
reliable programming and also the establishment of the more unusual 
programs that often are called for in simulation problems and might not 
have been anticipated by the computer manufacturer. 

There is another reason why the understanding of the basic electronic 
principles might be of particular interest to some readers. Often the need 
arises for a special-purpose analog simulator. It is often practical and desir- 
able to assemble such a simulator from the basic electronic module elements 
available commercially. This procedure might be preferable to tying up a 
more extensive general-purpose analog computer for a long-range problem. 
Such special-purpose simulators can be programmed and assembled only 
with some knowledge of the basic principles that are described here. On the 
other hand, knowledge of the intimate details of the internal circuitry 
involved in each electronic component will not be necessary. 
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2-2 Operational Amplifier 


The most basic element of the analog computer is the operational amplifier, 
represented by the schematic diagram of Figure 2-1. This is a high-gain 
electronic amplifier that might employ vacuum tubes or, more likely with 


ig ig 


ss — 
G O 
+ + 
ee & 
WUE A “4, 
chassis ground reference FIGURE 2-1 


modern units, transistors. An input voltage is applied, e,, commonly called 
the grid voltage. (This term arises from the historic fact that this voltage 
originally was applied to the grid of the first amplifier stage’s vacuum tube, 
and sometimes still is. In more modern units it is more likely to be applied 
to the base of the first stage transistor or to some other element.) The output 
voltage, e,, will then be some amplified version of e,. An acceptable opera- 
tional amplifier will have the following characteristics: 


1. When e, = 0, then e, = 0 + e,, where the null voltage, e., should 
be some very small fraction (e.g., 0.05 per cent) of the range of e,. 

2. e,/e, = —H, where “> 1; yw, the gain, may be a function of e, 
but should be at least 5000 in simpler computers intended for less 
accurate work and 100,000 or more with more accurate installations. 

3. The grid current, i,, that flows should be almost negligible so that 
it does not constitute any significant electrical load that might 
affect e, in consideration of the impedance of the electrical elements 
(e.g., feedback and input resistors) that will be connected to the 
grid. 

4. The amplifier should be capable of supplying output current /, to 
the other computer elements that normally might be connected to 
it without having the gain « reduced to the extent that condition 
2 no longer applies. 

5. The ability of the operational amplifier to handle time-varying 
signals, such as transient and random signals, may be expressed 
in terms of its ability to handle sinusoidal signals of various fre- 
quencies (i.e., in terms of the frequency response). This is described 
by the lower and upper limits of sinusoidal frequency, beyond 
which there will be an excessive distortion of either signal amplitude 
or phase. Just what this frequency range should be will be discussed. 
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Specification 1 relates to the zero-balance problem, where zero volts 
in should mean essentially zero volts out. This is handled in one of two ways: 


1, By manual control of zero balance, with appropriate meter indi- 
cations. The zero balance is then checked and readjusted occasio- 
nally for each amplifier. This is a common practice in the less 
expensive and less accurate types of computers. 

2. By an auxiliary automatic balancing circuit that repetitively checks 
and readjusts the zero balance. This is the technique used in the 
more precise and elaborate computers. 


Specification 2 refers to the high-gain requirements of the operational 
amplifier. The need for such a high gain will be obvious when the use of these 
amplifiers as summers and integrators is discussed in this chapter. It should 
be noted that the /inearity of the relationship between e, and e, is not essen- 
tial as long as the incremental gain, de,/de,, as well as 4, remains high over 
the entire voltage range of operation. 

The need for specifications 3 and 4 will also be obvious when the use 
of operational amplifiers as summers and integrators is discussed. 

Specification 5 depends upon the application of the computer. The 
computer should be capable of slow problem solution, which may involve 
runs of many minutes; this is particularly necessary with real-time simula- 
tion of process-control problems. Therefore, the lower frequency limit should 
be zero; direct-coupled amplifiers capable of amplifying d.c. as well as a.c. 
are required, The computer should also be able to handle high-frequency 
variations without distortion up to, perhaps, 100 Hz. An upper-frequency 
limit of about 5 kHz might be adequate for computers intended for such 
applications, 

It is, however, desirable to permit, as well, operation on a high-speed- 
repetitive basis.! (This capability is particularly necessary in connection with 
the dynamic-storage techniques discussed in Chapter 4.) This would involve 
only short solution times (e.g., 0.05 sec) but features a continuous repetition 
of the solution at a repetition frequency, such as 10 Hz. The results then 
are normally displayed on a cathode-ray oscilloscope. Because of the fast 
solution time required with such applications (a greatly sped-up time base), 
the required high-frequency response limit is greatly increased, possibly 
to as high as 1.0 MHz. 

Today’s many successful applications of analog computers are due to 
the ingenuity and perseverance of many people engaged in operational- 
amplifier design over a long period of time. A knowledge of the electronic 


1Many analog computers have been manufactured in the past that have been capable 
of only repetitive operation. This type is now becoming obsolete. 
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circuit details is not, however, essential to their successful utilization in simu- 
lation problems. This subject, therefore, will not be covered here. 

All operational amplifiers have a limited useful range of output 
voltage, V. Standard ranges are 50 and, more commonly, 100 V for ampli- 
fiers using vacuum tubes, and usually 10, but also 25, 50, and 100 V, for those 
using transistors. In the newer installations the tendency is toward transis- 
torized amplifiers with a 10 V nominal range. 

In any event, if the output of any operational amplifier is driven sub- 
stantially beyond its design range, this output will level off and eventually 
limit itself. This is accompanied by some type of warning indication to 
alert the operator. Such an overload condition does no damage other than 
providing erroneous results. (A properly designed operational amplifier 
should tolerate such overloads for sustained periods.) One of the functions 
of problem-machine scaling is the avoidance of such an overload condition. 

In the discussion to follow, reference will often be made to an “ideal” 
operational amplifier. Referring to specifications 5 above, this is a hypothe- 
tical amplifier in which 


. when e, = 0, e, =0. 

u=—e,/e, with u — oo. 

i, =0. 

. wis unaffected by i,. 

. the frequency range is from zero to co Hz. 


wReNe 


2-3 General Input-Output Relations 
with an Ideal Operational Amplifier 


When employed in linear operations, the e, and e, terminals are connected 
to each other through a linear feedback impedance, z,, and one or more 
input terminals are connected to the e, terminal through input impedances 
designated as z,, z,, etc. The result is shown in Figure 2-2. Since i, = 0, 
from the law of continuity of current flow (Kirchhoff’s current law), 


p= titi te +i, 


but 
i aa 
te Zz 
f 
and 
é;— é €,--€ e@. e 
i =o, i, = 2, 5, = 4 —+, ete. 
2 2, 23 
Hence 
e, e, e e e e@. e 
fo fn 4 Sa 4 Sa (2 42424--.4) 
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FIGURE 2-2 
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But e, = —e,/y; therefore, 
e, (14 244444...4 2) 
Hu 4 24 4 Z, 


(2-1) 
5 (Alomar Sterne Eten: anaes ) 
(Xe F z,° an z° ka 3 Zz," 
For the ideal operational amplifier, as 4 — oo the first term in parentheses 
becomes negligible and 


€, = — dhe, — Le, — Le, —--. — Le, (2-2) 
: 


This is the important relation upon which most analog-computer program- 
ming is based. The output voltage e, is the weighted sum of all input voltages, 
the weighting factors being the ratios of the feedback impedance to the 
particular input impedances. Only these impedances, not the amplifier itself, 
determine the input-output or transfer relationship. Hence a practically 
perfect linear relationship between input and output voltages can be expected. 


2-4 Simple Amplifier 


Figure 2-3 shows the connection of elements for a simple amplifier, Here 
only one input signal is employed, e,, and the input and feedback impedances 
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ey €0 
FIGURE 2-3 


are pure resistances; i.e., 
z,=R, zy =R, 
Then, from (2-2), 
aks zi 
ey = — Rees (2-3) 


The alternative diagram more often used in programming, rather than Figure 
2-3, is the one shown in Figure 2-4, where k is a stated numerical value equal 
to the ratio R,/R, and is called the amplifier gain (as contrasted to the much 
higher operational-amplifier gain, 4). The change in algebraic sign is not 
indicated in Figure 2-4 but is implied. 


.—{>—« 
FIGURE 2-4 


R, and R, may be chosen (within reason) in any combination of 
values in order to multiply an input voltage by any constant greater or less 
than unity. (To multiply by less than unity, potentiometers, discussed later, 
may also be employed.) There usually are practical limits to the values of 
R, and R,. Minimum permissible values are between 10,000 and 100,000 Q 
(with vacuum-tube operational amplifiers) in order to prevent errors caused 
by excessive loading of the amplifier (with reference to specification 1 in 
Section 2-1).2 Maximum permissible values are about 10 MQ; use of higher 
resistances can cause errors because of voltage drops caused by the grid 
current flow (recalling that the actual amplifiers will not be ideal). Hence 
amplifier gains as high as 1000 are obtainable but are rarely required in most 
computer applications if proper scaling is employed. With transistor-type 
operational amplifiers the same general limitations apply, except that the 
upper and lower limits of the resistances that may be employed will normally 
be smaller. 

When unusually high gains are required without resorting to unreason- 
ably high ratios of resistance, the method to be described in Section 2-12 
may be employed. 


2These values of resistance are about one-tenth as much for transistor type opera- 
tional amplifiers. 
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The most frequent use of a simple amplifier is as an inverter, where 
R, = R,; this merely accomplishes a change in algebraic sign. 


2-5 Summers 


Summers are simply an extension of the above principle where a number 
of input resistances are used. Figure 2-5 shows the arrangement. Here 
R R R R ) 
yey Re Ls a ee 2-4 
to — (Blas + Ree + Ree to + RS (2-4) 
The alternative diagram, used more often in programming, is shown in Figure 
2-6, where k,, k,, k,, etc., are the specific numerical values of the ratios 
R,/R,, R,/R3, etc. Again, algebraic sign inversion is implied. 


Ry 


FIGURE 2-5 


FIGURE 2-6 


2-6 Integrators 


If the feedback impedance element z, is made a capacitor so that z, = 1/C,s, 
with the input impedance z, remaining a resistance R,, an integrator results. 
Figure 2-7 illustrates this. Here, from (2-2), 


1 
far ecy RG" (2-5) 


The factor 1/R,C, has the dimensions of seconds”! and is described as the 
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Ry 


FIGURE 2-7 


integrator gain (i.e., the volts per second rate of output change per volt of 
input). In Chapter | the type of diagram shown in Figure 2-8 was used to 
represent such an integrator, where k is the specific numerical value of the 
integrator gain. 


FIGURE 2-8 
2-7 Summer-Integrators 
From the preceding discussion it should be obvious that the arrangement of 


Figure 2-9 combines the functions of summing and integrating in a single 
amplifier and that 


by = —A (hye, + kata + hoes +++ + kee) (2-6) 
Ri co 
ey 
Rz 
e2 
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63 
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where k, = 1/R,C,, k, =1/R,C,, etc. Another diagram for this is pictured 
in Figure 2-10. 

The program shown in Figure 1-22 did not employ such combined 
summer-integrators. It would have been possible to employ them; for 
example, the functions of amplifiers Al2, A1l3, and A20 could have been 
performed by one summer-integrator (using two less amplifiers as a result). 
However, if this had been done, the intermediate signal would not have 
been available as an indication. 
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FIGURE 2-10 


2-8 Differentiators 


Referring to Figure 2-7 it becomes obvious that the functions of the capacitor 
and resistor shown could have been reversed, as in Figure 2-11. Then 


e, = R,C,se, (2-7) 


Ry 
Cc 
e;,o—— eo 


FIGURE 2-11 


The output is now proportional to the time derivative of the input. This 
might at first appear to offer opportunities for using alternative forms of 
block diagrams in programming, as in Figure 1-5. Actually, such differenti- 
ating circuits are best avoided whenever possible. The reason for this can 
be explained by a Bode diagram relating the output and input amplitudes 
when signals of sinusoidal form of frequency @ are assumed applied. Such 
a diagram is shown in Figure 2-12. It may be noted that the gain increases 
without limit as the frequency is increased. There will always be some high- 
frequency noise present in analog computers from stray pickup from other 
equipment, power supply and vibrator hum, etc. Ordinarily, this is not at 
all noticeable. However, when such differentiating amplifiers are employed, 


0 wo 
cles (log scale) 
FIGURE 2-12 RG 


52 Basic Principles of Analog Computers Chap. 2 


these signals are accentuated and not only become noticeable but might 
even be excessive to the point of driving the amplifiers beyond the normal 
range of their output voltage into an overload condition, It is for this reason 
that the use of differentiating amplifiers is avoided whenever possible. 

When it is necessary to use a differentiating circuit, an imperfect form, 
as shown in Figure 2-13, generally is employed to avoid this problem. 
Here, for circuit (a), 


ey ae lee (2-8a) 


Ry CQ (a 
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FIGURE 2-13 
For circuit (b), 
ee, (2-8b) 


This no longer is a perfect differentiating circuit but has a response lag of 
R,C, or R,C, sec. For example, if a rate of change of e, is suddenly applied, 
e, would not immediately attain the new value of the time derivative but 
would approach this value with an exponential lag. Figure 2-14 illustrates this. 


e) €0 


ideal 
derivative 


e, =tu(t—a) 
ep =RyeC,(1 —e-/7) 


7=R,C,, (a) of 
Fig. 2-13 

= RyCy, (b) of 
a bd t Trig, 2-13 


FIGURE 2-14 


This circuit, however, has the advantage that the gain at high frequencies, 
and the consequent accentuation of noise, can be kept under reasonable 
control. The Bode diagram in Figure 2-12 is now modified to the form shown 
in Figure 2-15. 

In general, the effective programming of simulation problems will 
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avoid the use of differentiating elements when either analog or digital tech- 
niques are employed. 
2-9 Representation of Response Lag 


Frequently, two variables will be related as follows: 
k 


vin T+" (2-9) 
Under these circumstances, the relation could be written as 
3n = Elon = Ym) (2-10) 


The program for generating the y,, indication would be as shown in Figure 
2-16 if a summer-integrator were employed. 

An alternative viewpoint would involve the circuit of Figure 2-17. 

A comparison of the arrangements of Figures 2-16 and 2-17 would 
show that they are equivalent in all respects. 


Xm 
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FIGURE 2-16 


Ry = Rylk 
Xm Ym 


FIGURE 2-17 
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2-10 Representation of Lead—Lag 
Transfer Functions 


Particularly in the field of control, it will often be found desirable to add 
elements with the following type of transfer function to improve the control 
system: 
nites kh + 4,5 
my I+t5°" 

Depending upon the control problem encountered, t, may be greater or less 
than t,. The term lead-lag is applied to such transfer elements because the 
numerator produces a phase lead (when considered with respect to the res- 
ponse to sinusoidal signals) and the denominator produces a phase lag. 
Such a transfer function is accomplished by a number of different tech- 
niques in actual control problems; sometimes operational amplifiers are 
used just as with analog simulation. This relation may be simulated as in 
Figure 2-18. 


Ry 


FIGURE 2-18 


2-11 More Complicated Types of Input 
and Feedback Circuits? 


With some very special problems, input and feedback impedances are con- 
structed which are more complicated than those shown above. An under- 
standing of them requires some knowledge of electrical-circuit theory. The 
circuit of Figure 2-19 is an example. Here the feedback impedance is not of 
a simple series or parallel type but has an intermediate ground connection. 
It may be treated by means of Thévenin’s theorem. This is illustrated in 
Figure 2-20. Relation (2-2) may be employed if ¢,’ is substituted for e, and 
the equivalent z, is as shown in Figure 2-20. 


3This section may be skipped by readers interested only in standard programming 
with “closed” general-purpose computers. 
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FIGURE 2-20 
Scan vay Broke T+ R,C,s oon 
> Rt + RyCys 
1+ Ry,Cys 
where 
Ry 2 Ry, + Ry, 
Rgteby 
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Hence 
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Sees oy 
a RAI Rea) 


However, from Figure 2-20, 
e, = (1 + R,,C;ys)e,’ 
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Hence 
‘ie -Ra + R,C,s)e, (2-12) 


This arrangement be described as producing a proportional-plus-derivative 
effect. Because of the differentiating term, it has all the disadvantages dis- 
cussed in Section 2-8 as far as noise accentuation is concerned. 

The circuit shown here was used only to illustrate the general method 
employed for analyzing such more complicated arrangements. Such arrange- 
ments generally are not employed in ordinary simulation problems but 
rather for special purposes, as when analog circuits are to be used as part 
of the control equipment and the number of amplifiers to be employed is to 
be kept a minimum. Such arrangements are practical only when the type 
of operational amplifier is of the form to be described later as the open type, 
not found normally in general-purpose precision-type analog computers. 

A more general procedure that might be employed to obtain various 
desired transfer functions without resorting to such complicated feedback 
circuits is discussed in Appendix 2A. These methods will be applicable to 
closed as well as open-type computers. 


2-12 Increasing the Gains of Amplifiers by Reducing 
the Amount of Feedback 


The principles discussed in Section 2-11 do suggest one simple way of obtain- 
ing high values of amplifier gain without using unreasonably high ratios of 
the feedback resistance to the input resistance. The feedback signal is simply 
reduced by a potentiometer before being applied to the feedback resistor; 
this is equivalent to the use of a larger resistor. The scheme is shown in Figure 
2-21 as it would be applied to a summer. The gains will now be expressed 
by the relation 
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FIGURE 2-21 
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R R R 
ad Saree = uR,°? = aR 
where o is the potentiometer setting (see Section 2-17). 

This method for increasing gain may generally be applied with closed 
types of computers as well, as these usually have some provision for opening 
the circuit that normally connects the feedback resistor to the output and 
interposing a potentiometer. 

This principle might also be applied to an integrator for the purpose 
of increasing its gain, but it would operate in an imperfect sort of way. The 
method is illustrated by Figure 2-22, where « is the potentiometer setting. 
The potentimeter may be considered as a circuit element, as described in 
Section 2-17, and a circuit equivalent to those discussed in Section 2-11 
will then result. If this, in turn, is analyzed, it will be found that the input- 
output relationship will be given by the relation 

e, 1 R 

= aR, Cys a OR (2-13) 
The first term represents the pure integration effect, as desired, augmented 
by the factor 1/a%. However, the second term indicates that a normally un- 
desired proportional effect has been added as well, proportional to the 
value of the potentiometer’s total resistance R. 
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FIGURE 2-22 


2-13 Establishing Initial Conditions 


The discussion of integrators in Section 2-6 is not complete because it pro- 
vides for no method for establishing the initial condition of the output volt- 
age at time /¢,, = 0 (i.e., at the beginning of the computation period). This 
statement also applies to the arrangements shown in Figures 2-11, 2-13, 2-17, 
2-18, and 2-19. In all cases, all initial conditions, as determined by the 
initial charges on all capacitances used in either feedback or input circuits, 
must be established. 

The simplest method for accomplishing this is by means of a number 
of floating initial-condition power supplies. Such power supplies are called 
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V; 
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FIGURE 2-22a 


floating because, unlike most other supplies, there can be no definite 
connection to the computer ground. The symbol denotes such a supply. 
Normally, it may be manually adjusted to any value of voltage within the 
operating range of the computer. 

The procedure for employing such supplies is quite simple. They are 
connected through relay contacts to the capacitor involved, as shown in 
Figure 2-23. During what is called the initial condition (IC), or else the 


mode 
relay 


FIGURE 2-23 


reset mode, the relay contacts shown are closed. Each initial condition supply 
is then adjusted separately to the appropriate magnitude and polarity cor- 
responding to the initial conditions of the problem. This adjustment is quite 
simple and the results are observed through a meter while it is being made. 
After all the initial conditions are established, the computer is switched to 
the operate or compute mode. At the instant of starting this mode, all mode 
relays open their contacts and disconnect the initial-condition supplies. The 
capacitors then are all released and computation results. In instances where 
the proper initial condition happens to be zero volts, the initial-condition 
supply shown in Figure 2-23 is simply replaced by a short circuit. 

The technique described is used most often with those simpler forms 
of analog computer to be described later as the open type. With the more 
elaborate and precise closed type of computer, the accuracy requirements 
do not permit the use of such floating power supplies and a different tech- 
nique is used. It should be pointed out that the closed type of computer 
does not employ capacitors in any function other than as the feedback 
element of an integrator. (Other functions, such as those shown in Figures 
2-11, 2-13, 2-17, 2-18, and 2-19, may always be performed with integrators 
and summers alone.) Hence the problem of initial conditions becomes simply 
that of establishing the proper initial value of output voltage e, for all such 
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integrators. This may be accomplished by a scheme as shown in Figure 
2-24. In the normal operate position, the mode-relay contact is in the b 
position and the circuit is a normal summer-integrator similar to that of 
Figure 2-9 (or is a simple integrator, as shown in Figure 2-7, if only one 
input resistance is connected to the summing junction). When initial con- 
ditions are being set, (i.e., operation is in the IC or reset mode), the relay 
contact moves to position a. The circuit then has the form shown in Figure 
2-17 with the initial-condition voltage corresponding to the input. As the two 
R,’s are equal, the operation is that of a simple inverter with lag, and the 
output voltage e, approaches a value equal in magnitude and opposite in 
sign to the value of voltage applied to the IC terminal. The response lag 
associated with the attaining of this initial condition is R,C sec. (For this 
reason, the computer should be maintained in the reset mode for at least 
5R,C sec so that the proper initial conditions will be reached. In a real- 
time computer, R,C might typically be 0.1 sec; the reset mode then should 
be maintained for at least 0.5 sec.) 


IC terminal 
[set to—e, (0) V] 


input a 
resistances 


b 
1 
1 
summing 


a as a + junction & mas 
(SJ) relay 
FIGURE 2-24 


In Chapter | the question of establishing the initial conditions was 
disposed of rapidly by simply stating that the appropriate voltages be con- 
nected to the IC terminal of each integrator. The above discussion was for 
the purpose of explaining more completely what this procedure actually 
does. 


2-14 Hold Operation 
Referring to Figure 2-24, a third midposition of the mode relay could have 


been introduced where the e, terminal is connected to neither position a 
nor b, but remains disconnected. The equivalent situation may be created 
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by simply disconnecting all inputs to the integrators except that of the 
feedback capacitor itself. In either case, when this is done during computa- 
tion, the associated integrator will lock or hold, maintaining its output 
value. When returned to the operate mode, integration will continue from 
this point. 

Such a hold mode is convenient when it is desired that a computation 
be halted temporarily while all signals are being observed by some device 
such as a digital voltmeter. Operation continues again when the mode is 
returned to compute (or operate). 

It should be noted from the above that an integrator in the hold posi- 
tion functions as a data-storage device, storing the one particular value of a 
signal voltage. Compared to digital-storage techniques, it will have limits 
in regard to the duration of time during which such storage may be main- 
tained reliably. The reason for this is discussed next. 


2-15 Limitations of Capacitors Used in Computers 


All analyses of the performance of circuits using capacitances that were 
described here were based on the assumption that the capacitance was ideal. 
In reality, physical capacitors are never perfect, although those used in 
high-precision analog computers do come as close to perfection as is possible 
(hence their cost). Nevertheless, all capacitors will possess some leakage, 
equivalent to a high resistance in parallel with the actual capacitance para- 
meter, and also some dielectric hysteresis, represented very approximately 
by a resistance in series. Figure 2-25 illustrates this. (For an ideal capacitor, 
R.— 00; R.— 0.) This deviation from perfection normally can be 
ignored in most analog-computer programming problems. Nevertheless, 
the limitations that it does introduce should be kept in mind. As a result 
of these effects, the integrator shown in Figure 2-7 no longer will provide 
a perfect mathematical integration. However, the deviation from perfection 
will be obvious only under unusual circumstances, as when a computer 
solution is to be obtained over a long period of time (order of 10 min or more 
for precision computers, 1 min or more for less precise ones). 


FIGURE 2-25 


It is this limitation of capacitances that prevents an integrator being 
operated in the hold position from being an almost ideal storage device. 
If the initial output voltage of such an integrator is e,(0), the voltage 7 sec 
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later, after being placed in the hold position, will be 


e, = e,(0) exr(z-c) 


In other words, the voltage being held will eventually drift toward zero. 
However, in a high-precision computer reliable holding action can be 
maintained for several minutes. 


2-16 Open Versus Closed Computers 


The terms open and closed computers have been used in discussions up to 
this point and should be clarified. To a limited extent these two types might 
also be referred to, respectively, as cheap and expensive computers—how- 
ever, this point should not be overemphasized, as the first type often is 
admirably suited for the solution of many problems. 

In general, the term open computer refers to computers in which the 
operational amplifiers are directly available to the user, having only e, and 
e, terminals. As they are generally intended for less precise work, they 
normally employ manual rather than automatic null-balancing techniques. 
This feature, which helps make the computer less expensive, may seem to 
detract from convenience of operation. In fairness it might also be stated 
that the avoidance of automatic-balancing circuits also avoids one possible 
item of troublesome maintenance, 

With such open computers the feedback- and input-impedance ele- 
ments are normally external components that are “plugged in.” Often they 
are not even supplied by the computer manufacturer but must be obtained 
separately; any reasonably precise line (--1 per cent) of resistors and capa- 
citors will do. A large collection of various sizes of each are stored and hence 
combinations are possible far beyond those available with the closed units. 
Obviously, this technique does not permit the use of temperature-controlled 
environments for such elements and, as a result, such open computers are 
considerably less accurate. 

One advantage that open computers possess is flexibility, as it is quite 
easy to connect various complicated types of input and feedback impedances. 
However, this flexibility is of no particular value unless the person doing 
the programming has a reasonable knowledge of electrical-circuit theory 
(not a requirement with closed computers). Because of this, such computers 
are often preferred for educational purposes, where very precise solutions 
are not necessary but where it is desired that the users obtain a full under- 
standing of the principles, rather than simply learning the routine procedures, 
for establishing a program. 

In his own consulting experience with industrial organizations con- 
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templating the use of analog computers for the first time, the author has 
usually recommended that the first investment be in such an open-type of 
computer. In addition to the obvious advantage of relatively low expense, 
it has the additional advantage of educating the users to basic analog- 
computer principles. In some instances, where the degree of complication 
of the problems being handled was not too severe and where the accuracy 
requirements were only moderate, it was found that such open-type com- 
puters were adequate for all demands made by such organizations. 

With more complicated problems, or where a higher degree of accuracy 
is necessary, closed computers are required. Such computers are described 
as closed because the elements for feedback input impedances must be held 
precisely to their nominal values if the expected accuracy (normally 0.1 
per cent) is to be maintained. This can be accomplished only if they are of 
precise design and if they are maintained in a temperature-controlled envi- 
ronment. Such environments are thermostatically controlled ovens. 

With the use of such oven-enclosed components (resistors and capa- 
citances), obviously only a limited number of such elements can be accom- 
modated. In a typical instance with a vacuum-tube type of computer, six 
input resistances are available for each summer or integrator amplifier 
furnished, three of 0.1 MQ value and three of 1.0 MQ value; only one 
feedback element is provided, 1.0 MQ for summers and 1.0 “F for inte- 
grators. For such a typical case, the summer circuit would appear as shown 
in Figure 2-26. An input applied to any of three upper resistors results in 
an amplifier gain of 10; one applied to any of the three lower resistors, 
a gain of unity. Hence the markings to the left of the input terminals indicate 
the gain obtained. Of course, an input signal may be applied to more 
than one input terminal, effectively placing the associated input resistors 


0.1 MQ 1.0MQ 


FIGURE 2-26 
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in parallel. Therefore, with the example shown in Figure 2-26, gains of 
1, 2, 3, 10, 11, 12, 13, 20, 21, 22, 23, 30, 31, 32, and 33 are all possible. 
Frequently, the amplifier gain required will not correspond to any of these 
values; the next higher gain of 1, 2, 3, 10, 20, or 30 then is generally chosen 
and a potentiometer is added to the input to reduce the actual gain to the 
exact value desired. 

The common tie point of the input and feedback elements is called 
the summing junction (SJ) in Figure 2-26 and in many computer layouts. 
As shown, it is normally connected to the grid terminal (G) of the operational 
amplifier. However, there is usually a provision for removing the connection 
between the SJ and G terminals to free the amplifier for less orthodox 
applications. 

Typical integrator connections in a closed type of computer are similar 
to Figure 2-26, the only exception being the substitution of a 1.0-mF capa- 
citor (for real-time computers) for the 1.0-MQ feedback resistor, and the 
addition of an initial-conditions arrangement such as is shown in Figure 
2-24. The same input provisions usually prevail with the input-gain values, 
such as | or 10 now applying to the integrator gains (volts per second output 
rate per volt input). 

All the input and feedback elements shown are permanently associated 
with a given amplifier and are enclosed in temperature-controlled ovens. 
Frequently, some additional resistive and capacitive elements are also 
enclosed in such ovens with free connections so that they may be added 
to computer circuits in various ways. In any event, the degree of compli- 
cation permitted of the input and feedback capacitances will definitely be 
limited. This is one of the prices that must be paid for the greater accuracy 
obtainable with closed computers. 


2-17 Potentiometers 
A potentiometer provides a method for multiplying a voltage by a prescribed 


factor, £ (B is always less than unity), based on the voltage-divider principle 
shown in Figure 2-27. /f there is negligible current drawn from the e, output 


FIGURE 2-27 
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terminals, then 
R 
api tee 

2 Res Ri 
where « = R,/(R, + R,) is the potentiometer setting. Hence here, with no 
output load, # = a, where f is the potentiometer factor. In a potentiometer 
the sum of the resistances, R = R, + R,, is constant but the separation 
between R, and R, is variable by a movable tap (i.e., # is variable and will 
be a function of the mechanical angle of the potentiometer, 8). This is illus- 
trated in Figure 2-28. 


= we, (2-14) 


R,=aR 
R, =(1-R 


FIGURE 2-28 


In this chapter we are concerned with linear potentiometers where 
o« =k@ and hence where, at least under conditions of no output load, 


e, = kBe, (2-15) 


Hence the potentiometer setting will be a linear function of the mechanical 
angle. Such potentiometers are normally rotated by a calibrated-dial mecha- 
nism with micrometer indications by which the potentiometer setting @ is 
indicated to about three decimal places. 

Relations (2-14) and (2-15) apply only when no current is being drawn 
from the e, output terminal. If, as is usual, a load is connected to the output 
terminal of the potentiometer because of the elements that follow it in the 
program, these relations no longer apply exactly. The potentiometer factor 
B will no longer be exactly equal to the setting o indicated by the dials. It is 
possible to compute the error produced by a given load and to prepare 
charts that will permit a compensation of this error. These are, however, 
tedious to use. 

The most reliable and easiest way to set the potentiometer factor 2 
is by applying a fixed reference voltage V, to the potentiometer’s input 
terminal. The output voltage is then observed, usually by a digital voltmeter, 
and the potentiometer setting varied until this voltage equals BV,. As Vp 
generally is 10 or 100 V in most computers, this adjustment is very easy to 
make. The necessary connections for this potentiometer-setting mode are 
usually established automatically by the simple throwing of a master switch 
on the computer console. 
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In view of this convenient method for setting potentiometers, little 
electrical knowledge is required of the programmer. He should, however, 
be aware of the fact that the potentiometer factor is affected by load and that 
all elements that establish this load should be connected to the potentiometer 
before the setting of potentiometers is attempted. If a change of program 
calls for a change in any of these output elements, a resetting is necessary. 

In some analog-computer programs (as described in Chapters 4 and 
6) the potentiometer may supply elements presenting electrical loads that 
change during the course of program operation. (Examples are diodes and 
comparator switches.) Then a potentiometer setting that may be correct 
during some parts of the operation may cease to be correct during other 
parts. When this presents a problem, the use of unloading circuits, discussed 
in the next section, may prove necessary. 


2-18 Unloading Circuits 


There will be circumstances, such as those mentioned in Section 2-17, in 
which it will be important that absolutely no current be drawn from an ele- 
ment in a computer, such as a potentiometer. In these instances the output 
of the element first is fed to an unloading circuit, and from this circuit in 
turn to whatever elements are to be supplied. Such an unloading circuit is 
simply a modified form of an inverting amplifier that has essentially infinite 
input impedance. Figure 2-29 is one example of such a circuit. 


. 
No.1 


FIGURE 2-29 


In this circuit the voltage e, is supplied by some source (such as a 
potentiometer), but the load current /, that is drawn from that source must 
be zero. As amplifier 1 has identical feedback and input resistances, it serves 
as a simple inverter and e, = —e,. The current through the input resistor 
R, or i,, must be e,/R (since the grid terminal of amplifier | is at the poten- 
tial —e,/y, or essentially zero). 

The voltage out of amplifier 2, or e,, is —2Pe,, or 2Pe,, where P is 
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the potentiometer factor of the potentiometer P shown in the diagram. 
The unloading current i,, therefore, is 


i, — fue 2P—1 


STO ins mar 
If i, equals i,, then no load current i, will flow. The condition for this is 


ey 


2P — iy — 4 
OARS R 
or 
P= 0,55 


Hence, with such a potentiometer factor, the circuit of Figure 2-29 will 
function as an inverter but will have the special property of drawing no 
current from whatever source supplies it. If the inverter action that occurs 
incidentally is not desired, it is simply necessary to follow this circuit by 
another conventional inverter. 


2-19 Ungrounded Potentiometers 


With all the applications discussed up to now, the function of a potentiometer 
has been simply to multiply some voltage by a factor f, where f is less than 
unity. In such applications the conventional potentiometer connection is 
used, where one side of the resistance element is connected to the computer's 
chassis ground. 

There will be other applications where the function of the potentio- 
meter will be to combine two voltages, e, and e,, in some adjustable pro- 
portion according to the relation 


e, = ae, + (1 — ae, (2-16) 


This can be done as shown in Figure 2-30, utilizing what is known as an 
ungrounded or floating potentiometer. The Figure 2-30 arrangement is indi- 
cated symbolically in Figure 2-31. 

Any conventional potentiometer may be used in such an application 
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FIGURE 2-30 
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if there are provisions for ungrounding the normally grounded bottom lead 
so that the voltage designated as e, may be applied to it. In most computers 
a limited number of potentiometers are furnished that do have such pro- 
visions. 

Relation (2-16) will apply to such an arrangement only if there is no 
output load. Unlike conventional grounded potentiometers, the effect of 
loading cannot be compensated by offsetting «. With a fixed load resistance 
R,, an analysis similar to that in Section 2-17 will develop the relation 


ae, + (1 — we. 

ote aaah, ae 
Hence loading does not change the proportion by which e, and e, are 
combined, but it does reduce the signal-transmission factor of the combined 
voltages. In a number of applications of floating potentiometers, only the 
relative proportion of e, and e, transmission is important. However, in 
applications where this loading effect does constitute a problem, either an 
unloading circuit should be used or a summer should be employed in place 
of the potentiometer. 


2-20 Reference-Voltage Supplies 


Chapter 1 showed instances where a specific voltage has to be provided for 
the purpose of (1) applying the correct initial condition voltage to an inte- 
grator, or (2) applying an input or disturbance voltage (independent variable) 
such as a step function. There will be other instances when such reference 
voltages are required. 

Normally, the references voltages available are +-V,, where V, is the 
nominal voltage range of the computer (e.g., 10, 50, or 100 V). Sometimes 
additional values of reference voltage will be available as well. In any event, 
other values of fixed voltage that may be needed can be obtained by con- 
necting potentiometers to the reference supply. 

In some instances a switch is made available that simultaneously 
reduces all reference-voltage supplies by a given factor, such as 10. As will 
be obvious from the discussion of scaling to follow, this will be useful when 
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first investigating a program to see whether the proper scale factors have 
been selected. Suppose, for example, that the computer’s voltage range 
V, is 10 V. A test run is made with the reference voltage reduced by a factor 
of 10 and it is found that the output of one amplifier reaches a value of 1.5 V 
during a portion of the run. With the normal reference voltage, this would 
have corresponded to 15 V and an overload condition would have resulted. 
The scale factors selected obviously are incorrect and will have to be modi- 
fied on the basis of the information thus obtained. 


2-21 Mechanics of Establishing the Program 
Connections 


In the open type of analog computer likely to be used for instruction in basic 
analog-computer principles, the connections of the actual physical elements 
are likely to be made directly through terminals or jacks located on the 
front panel. With the more precise closed type of computer, patchboards 
that establish the interconnections between elements normally are used in- 
stead. The actual elements are enclosed within the computer, their connec- 
tions being brought to the patchboard terminals through trunk wiring. A 
variety of leads and jumpers are inserted in the patchboard to establish the 
program. As such patchboards generally are removable, a program may be 
stored and a different program employed with the computer by the sub- 
stitution of another board. 

Still another possible method for establishing the program connections 
is by means of electrical relays. This procedure is most likely to be used in 
hybrid analog-digital installations and would permit the analog program 
description to be stored in digital form. The associated digital computer 
then establishes the necessary program connections on the basis of a digital 
record. Still more refinement, extending the automation of establishing the 
digital program further, is the use of servo-driven potentiometers that may 
also be adjusted in accordance with digital instructions. A computer so 
equipped represents the ultimate in operational convenience but, unfortun- 
ately, also in initial expense. 


2-22 Selection of Analog-Computer Scale Factors 


The first point that should be made in regard to the selection of scale factors 
is that, for intelligent scaling, some idea of the results to be expected should 
be known. This can be possible only if the person planning the program is 
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trained and experienced in the analysis of the particular phenomena being 
studied.* 

The second point to be made is that scaling errors in programming 
are not “fatal,” and in any complicated program being run for the first 
time, some errors, but not gross errors, are to be expected. After all, if the 
person doing the programming could predict exactly the response of the 
system being simulated, there would often be no point at all in performing 
the simulation. As the cost of executing an analog program is often negli- 
gible, no great inconvenience is involved in changing one, or at the most, 
several scale factors after inappropriate scaling has been observed by means 
of trial runs. 

The scaling problem is subdivided into two parts; time scaling and 
voltage scaling. Time scaling consists of selecting the factor k, in the relation 


t=Kit,. (2-18) 


When slow solutions are desired for convenience or are required because 
of response-speed limitations of the output equipment, k, will be small. 
With rapid solutions, as with the oscilloscope display of the output, &, will 
be large. For an important type of simulation, called real-time simulation, 
when the computer represents a model of the system that is undistorted in 
the time scale, k, must be unity. 

Voltage scaling is based on two considerations. None of the voltage 
variables should be permitted to go beyond the nominal voltage range of 
the computer (e.g., 10, 50, 100 V). On the other hand, the voltage range of 
the machine variable should be some appreciable fraction of the total nominal 
range so that these voltages may be measured readily and will not be masked 
by drift or noise. When nonlinear functions or multipliers are treated later, 
it will be found that their percentage of accuracy deteriorates rapidly as the 
voltage becomes small; these will present additional reasons for having as 
large a voltage “swing” as is possible and permissible. In other words, there 
are the possibilities of either too much or too little. 

Finally, before going into specific details of selecting scale factors, 
the point should be made that these factors should always be convenient 
round numbers, usually decimal multiples of 1, 2, or 5. If this is done, it 
becomes relatively simple to observe the machine results in terms of volt- 
ages, and to interpret them directly in terms of the actual units of the prob- 
lem. 


4This comment brings up an important consideration regarding the choice of person- 
nel involved in preparing a simulation program, It is sometimes believed that simulation 
programs may be prepared by programmers who are not acquainted with the field related to 
the application being simulated. As far as the initial program planning is concerned, this is 
not the case with either digital or analog simulation. However, after the basic simulation 
arrangement has been established, a trained programmer may be able to suggest methods of 
greater improvement. 
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2-23 Time Scaling 


No choice of time scale is available, of course, with real-time simulation; 
k, must be unity. In other instances, the first consideration must be given 
to the maximum value of k, that is permissible in view of response-speed 
limitations of components used in the computer and of the output equip- 
ment. 

Next, consideration is given to the minimum value of k, permissible 
in consideration of the storage capability of integrators and the method of 
output display or recording. If a repetitive oscilloscope display is desired, 
as described later in this chapter, the limits of screen persistence dictate a 
total solution time that normally does not exceed 0.100 sec (for each solution 
repetition). In the problem of the example of Chapter 1, a solution time 
of 0.100 sec (actual problem time) was desirable in order to describe the 
response transient completely; hence a k, of 0.100/0.100, or unity (which 
happens to correspond to real-time simulation), would be appropriate. 

However, in the example of Problem 1-1 a recording oscillograph was 
selected for output display. Here consideration should be given to the maxi- 
mum frequency-response limitations of such a device. A preliminary study 
of the problem involved (referring back to Section 1-2) shows that there 
should be a dominant resonant frequency of 


_ [kg _ _/(20)(980) _ 
o, = Nee = eesti tae = 198 rad/sec 


or 198/22 = 32 Hz. The oscillograph used has a frequency response ranging 
to 80 Hz; hence, for recording the results of this problem solution, a k, 
of unity would not have been excessive from the standpoint of oscillograph 
capability. This, however, would have meant a solution time of 0.100 sec 
of machine time; a fast paper speed would have been required of the oscil- 
lograph, and considerable paper wastage would have resulted when manually 
controlling the starting and stopping of each run. Ordinarily, the speed of 
solution is not so urgent an item that a 10 sec solution time would not be 
more convenient. The actual time scale used was selected on this basis, with 
ak, of 0.01. It was this value that was used when producing the results shown 
in Figure 1-20. 

For other methods of output display, even smaller k,’s (slower solu- 
tions) might be advisable. Suppose, for example, that the results are to be 
observed visually on a digital voltmeter with the intention of interrupting 
the solution periodically (by placing all integrators in a hold mode—see 
Section 2-14) so that the pertinent response values might be recorded, 
possibly by a digital printer. For such purposes a k, of 0.0001, corresponding 
to a solution time of 1000 sec, might be desirable. For reasons to be men- 
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tioned below, this would represent close to the upper limit of solution time 
with a typical precision-type analog computer. 

In Section 2-15, the limitations of the capacitors used with integrators 
were discussed. Because of the inevitable leakage of even the best capacitors, 
there are definite limitations to their ability to store voltages for extended 
periods of time. With some computers the solution time of 1000 sec, sug- 
gested above for visual observation of the output, might be excessive, and 
a solution time not exceeding 100 sec might be necessary to guarantee rea- 
sonably accurate results. 

When selecting the time scale k,, thought should also be paid to the 
limitations of the computer elements as well as the output equipment. The 
minimum limitation of k, is generally caused by capacitor leakage, as was 
discussed above. There also is a maximum limitation of k, imposed by the 
high-frequency-response limits of the equipment. The program associated 
with the example of Chapter 1 required only conventional linear elements 
(amplifiers, summers, integrators, and potentiometers); all these have fre- 
quency-response ranges up to about 100,000 Hz for a high-quality computer. 
In consideration of the dominant resonant frequency of the problem in the 
example (computed above as 32 Hz), this limit is not a significant factor 
when selecting the time scale. However, in more complicated problems, 
computer elements may be employed that have considerably slower responses. 
For example, electromechanical servo-driven multipliers or resolvers* 
might have been used. Such devices have upper frequency-response limits 
that sometimes are as low as | Hz. If this were the case, then in a problem 
such as this where the dominant response frequency is 32 Hz, a k, of +5, 
or 0.03, would represent the maximum permissible time-scale factor. 


2-24 Change of Time Scale 


In some instances it is desired to change the time scale of a problem after 
the programming has been completed. One way of doing this is by changing 
the values of all capacitors involved by the same factor—increasing the capa- 
citance values reduces k, (lengthens the time required for a solution) by the 
same factor. 

In many problems such as that of the example of Chapter 1, the only 
computers used were those associated with integrators. In this event, time 
scale could also be changed by changing a// integrator gains by the same 
factor. Here an increase of integrator gain results in a faster solution (i.e., 
a higher k, by a factor equal to the change in gain value). 

The above principle is often used when revising a program after it is 


5These devices are now becoming obsolete but are still in extensive use. 
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decided that a change of time scale is desired. Simple provisions for such 
a change are also included in some computers. For example, the standard 
feedback capacitor used with all integrators might be 1.0 mF for normal- 
time operation, Throwing a master switch to a “fast” position effects a 
substitution of 0.01-mF capacitors. Operation then is 100 times faster than 
in the normal position. Sometimes, a “slow” position is also provided where 
10-mF capacitors are substituted instead. 


2-25 Determination of the Voltage-Scale Factors 


To select a scale factor for each variable to be represented in a given simula- 
tion problem, it is first necessary to estimate the maximum range of varia- 
tion of each of these variables. This procedure is demonstrated best by using 
again the example of Chapter 1. As in Chapter 1, it will be assumed here 
that an analog computer is being used that has a nominal voltage range of 
+100 V. 

Referring to Figure 1-3, the variables to be represented are seen to 
be x, x,y, ), 5, f;,fy, and fy,. Of these, the independent variables should be 
considered first. A knowledge of their range of variation requires some 
understanding of the application of the mechanism being simulated. It will 
be assumed here that the input displacement, x, may attain magnitudes as 
great as 6 cm, and the associated input velocity, x, magnitudes as great as 
1500 cm/sec, Now, considering x, a magnitude of |x| = 6 cm should result 
in a machine-voltage magnitude | x,,| that equals, or is somewhat less than, 
100 V. The factor +85, or 0.06, would make | x,,| exactly 100 V. However, 
such a factor is not sufficiently round to be convenient and the next higher 
round factor, or 0.1, is chosen instead; i.e., 


x =0.1x,, cm 


and the maximum range of 6 cm would cause a voltage range of 60 V. 

Similarly, considering x, a magnitude of || = 1500 cm/sec would call 
for an exact scale factor of 1500/100 or 15. The next higher round conversion 
factor of 20 is employed and 


x = 20%,, cm/sec 


This completes the scaling of the independent variables. 

Among the dependent variables, y and > normally would be expected 
to employ the same scale factors as x and x, respectively. In the problem of 
this example, this is a reasonable procedure since, with constant x, y would 
approach the same steady-state value and, with constant x, would approach 
the same value of velocity if + could be maintained for a long enough time. 
(Furthermore, it is usually desirable to observe the variations of x and y 
together as they appear in the output display, and this is most convenient 
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if they are shown with the same relative scale.) Hence 
y=0.1y,, cm 
y = 207, cm/sec 

The remaining dependent variables may now be considered by tracing 
through the block diagram of Figure 1-3. The maximum magnitude of (x — ») 
would result from a step change of x by the maximum expected value of 
6cm; this would result in an f, of k|x — y| = (20)(6) = 120 kg. The maxi- 
mum value of (x — ¥) would be 1500 cm/sec (resulting from a suddenly 
applied ramp change of x); then the maximum value of f, would be B| x — }}| 
= (0.05)(1500) = 75 kg. Now, considering the summation shown in Figure 
1-3 that produces f,, and assuming the most extreme case of these maxi- 
mum values adding directly, a maximum f,, of 120 + 75 kg might be con- 
sidered (the effect of the gravity force M, also added, is negligible for the 
purpose of these scaling computations). Hence it is estimated that | f,,| is 
195 kg, and it is considered that this should not result in a machine voltage 
of greater than 100 V. The exact conversion factor then is }%§, or 1.95, 
and the next higher round number is used (i.e., fy = 2fy,, kg). It will be 
convenient to employ the same factor for all forces, so, in general, 

A ¢ 
The above applies to all the forces, f,, fy, fy, and M. 

In the above a possible peak magnitude of f,, equal to 195 kg was 
estimated. This, in turn, would cause an acceleration magnitude of # equal 
to (195/M)g = (195)(980)/0.5 = 382,000 cm/sec*. For this to correspond 
exactly to 100 machine volts, the exact scale factor would be 382,000/100 
= 3820; in practice the next higher round factor of 5000 was employed: 

J = 5000F, cm/sec? 
All the voltage-scale factors have now been established for the variables 
shown in Figure 1-3. These correspond to those listed in Section 1-6, 

One additional comment might be made regarding a scaling problem 
that occurs frequently, although it did not arise in the example just treated. 
Let a different type of problem be considered where the variable concerned 
is, say, N, the rpm of an engine, with N varying between the limits of 2300 
and 2500 rpm. If the procedure described above were used, |N| would be 
2500 rpm and would be made to correspond to 100 V on the machine. Then 
N=25N,,rpm and the actual variation of N,, would be between +92 
and +-100 V. Only 4 per cent of the +100 V range of the computer would 
be utilized. To make better use of this range, it would be preferable to simu- 
late, instead, the increment of N, or AN, defined as, say, 


AN = N — 2400 
The magnitude | AN | is now merely 100 rpm and the appropriate conversion 
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factor would be unity, indicated by the relation AN = AN,,. The full voltage 
range of the computer would now be utilized with a resulting improvement 
in accuracy (particularly if nonlinear elements should be required in the 
program). 


2-26 Odd-Amplifier Rule 


When preparing an analog program, it is quite easy to lose track of the alge- 
braic sign, especially considering the sign inversion usually occurring with 
each amplifier. To provide a final check on errors of sign, the odd-amplifier 
rule, applicable when the amplifiers are of the inverting type, is often pro- 
posed, To apply this rule, every closed Joop in the computer program is 
traced; each of these should involve an odd number of amplifiers. There 
are only two such loops in the example shown in Figure 1-22. (In more 
complicated programs, many more would appear.) These loops include an 
upper loop (as drawn in the diagram) involving amplifiers A1l2, Al3, A20, 
A14, and A30, and a lower loop involving amplifiers Al2, A13, A20, A21, 
and A04. The rule is satisfied here because in both cases the number of 
amplifiers involved is odd. The value of this rule is pointed out by the fact 
that in such a program construction it would have been very easy to have 
omitted the inverter, Al4, by error; this rule would have spotted such an 
error. 

The rule is a useful one, but note should be taken of the fact that 
it is not always applicable. It is based upon the fact that in most situations 
of system dynamics closed loops normally will be associated with negative 
feedback. As the block diagram of Figure 1-3 shows, this is the case for 
the example treated there that led to the Figure 1-15 program. However, 
there will be exceptions to this negative-feedback rule, many of them impor- 
tant. Many problems do arise where positive feedback will exist. Examples 
are statically unstable aircraft, mechanical toggles, the compound-interest 
problem of Chapter 1, etc. Whenever such positive feedback is the case, 
this fact should be recognized and an even number of amplifiers should 
be expected in the associated loop. 


2-27 High-Speed-Repetitive Operation 


In Section 2-23 it was mentioned that in many cases an oscilloscope display 
of the output variables is desired, and that such a method of display requires 
a fast and repeated solution. Many computers have provisions for such a 
repetitive solution and there are some that can operate on/y in such a mode. 
To adapt a computer ordinarily intended for real-time solutions to such 
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a high-speed-repetitive (HRO) operation, it is of course first necessary that 
the frequency range of the computer’s functional amplifiers be adequate. 
The computer is then operated in a fast mode; that is, a procedure as des- 
cribed in Section 2-24 is used to increase k,, such as by having a master 
switch and relay change all integrator capacitors to some lower value of 
capacitance. The repetitive feature is introduced by alternately returning 
the computer to the initial condition, or reset, mode long enough for initial 
conditions to be reestablished, and then to the operate, or compute, mode 
long enough to accommodate the desired solution time. Computers equipped 
for this type of operation have timing devices that establish such a cycle; 
the appropriate relays, as shown in Figure 2-24, one for each integrator, are 
simultaneously actuated. The rate of repetition is usually adjustable, either 
continuously or in steps. 

In a typical problem where the variable of interest, say y, might have 
a response as shown in Figure 2-32a, the resulting response with such repet- 
itive operation would be as shown in part b. It should be noted that only 
the portion of the response occurring during the compute periods has any 
significance as far as results are concerned. 


y 


t machine time, 
‘m 

1 ee sec 
(a) Solution of y in normal operation 


C, compute mode 
R, reset mode 


tm, Machine time, 
0.01 0.02 sec 
(b) Solution of y in high-speed-repetitive operation 


FIGURE 2-32 


When such a repetitive solution is to be displayed on a cathode-ray 
oscilloscope, the horizontal sweep on the CRO, representing time, should 
be synchronized with this switching operation. If the high-speed switching 
is done within the computer itself, this may be accomplished by also devel- 
oping the sweep voltage within the computer as well as by means of an inte- 
grator amplifier. 

In some more elaborate installations, a cathode-ray oscilloscope 
(usually of the multichannel type using an electronic switch) is furnished 
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that develops its own sweep voltage and also controls, synchronized with 
this time sweep, the repetitive switching of the computer, In such instances 
the repetition frequency is controlled at the oscilloscope, not at the computer 
itself. 

It may be noted from Figure 2-32b that there is a response during the 
reset mode that is not of interest in the problem solution and preferably 
should be omitted from the oscilloscope display. With the oscilloscope- 
controlled type of repetitive operation described above, provision is usually 
included for blanking the oscilloscope screen during this reset period. 

Such high-speed-repetitive procedures, associated with oscilloscope 
displays, are especially convenient when a trial-and-error adjustment of 
some parameter should be made to achieve desired results. It is merely nec- 
essary to observe the results on such a display while adjusting the potentio- 
meter associated with the variable parameter until the results desired are 
obtained. 

The application of high-speed-repetitive operation to dynamic-storage 
techniques will be described later. This technique is used when the major 
part of the problem is being solved with normal operation, but certain 
auxiliary computations must be made repeatedly and rapidly. It will be 
found that this latter technique will be roughly analogous to the use of sub- 
routines with digital computers. 


Suggested Problems 


2-1. Section 2-10 shows the configuration of a lead-lag transfer-function 
simulation using an analog computer having open amplifiers and an ade- 
quate selection of plug-in type resistors and capacitors so that any para- 
meters k, t,, and t,, may be obtained. 

Suppose that, instead, a closed type of computer is available with 
no access to individual resistors and capacitors. The only summing ampli- 
fiers available have two sets of input terminals, a set of three providing a 
gain of unity, and a set of three providing a gain of 10. Integrators are 
identical to summers except that the 1.0-MQ resistor used in the summer 
is replaced with a 1.0-~F capacitor when the amplifier is used as an integrator. 
Potentiometers also are available. 

Devise a program with such components that will accomplish the same 
operations as in Figure 218 and that will 
(a) employ a minimum number of amplifiers, or 
(b) employ a minimum number of amplifiers with the added stipulation 

that k, t,, and t, can be set individually and independently with separate 
potentiometers. 
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2-2. Figure 2-16 shows a technique for representing a simple response lag 
of t sec by means of closed amplifiers. Of course, potentiometers will also 
be required, as it is unlikely that the exact gains, k/t and 1/t, shown in that 
diagram will be available in a closed amplifier. However, a direct adaptation 
of the Figure 2-16 arrangement would require that both potentiometers 
be adjusted in order to adjust the time constant Tt. 

Assume a closed computer as in the previous problem. Develop an 
arrangement for representing such an operation so that only one potentio- 
meter is required to adjust the value of k, and only one to adjust, separately, 
the value of 7. 


2-3. The analog-computer circuit of Figure P2-3 is sometimes employed. 
what will this circuit accomplish? 


ag 
{> mes 


FIGURE P2-3 
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2-4. Frequently, particularly when simulating some types of system control- 
lers, it is necessary to perform the operation 


(a) Using closed amplifiers only, as described in the previous problems, 
devise an analog-computer arrangement to simulate this operation with 
two potentiometers, one controlling the factor k, and the other the 
factor k/t. 

(b) Repeat (a) with the new proviso that the second potentiometer control 
is simply 7, instead. 

(c) Devise an arrangement using open-computer construction for accom- 
plishing the simulation of the above function with only one amplifier. 


2-5. Develop an analog-computer program to develop simultaneously the 
machine variables x = 10 cos wt V and y = 10 sin wt V. (Hint: Determine 
the differential equations where these expressions will constitute the time 
solutions; construct the block diagram corresponding to these equations; 
proceed from there.) 
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2-6. The program constituting the solution to Problem 2-5 has been devel- 
oped. However, the actual operational amplifiers employed cannot be con- 
sidered as ideal; their finite gain 4 of only 100,000 must be considered. As 
a result, the amplitude of the sinusoidal signal produced will be found to 
decay with time. How rapidly will it decay to one half the original amplitude? 
Will it do this in a specific length of time, regardless of frequency, or will 
it do this after a specific number of cycles? 


2-7. As in Problem 2-6, this again refers to the program for the solution of 
Problem 2-5. Here the operational amplifiers may be considered as ideal. 
However, the integrators each employ a 1.0-mF feedback capacitor that has 
a shunting leakage resistance of 100-MQ. Again, as a result, the amplitude 
of the signals will decay with time. How rapidly will they now decay to one 
half the original amplitude? Again, will they do this in a specific length of 
time or after a specific number of cycles? 


2-8. In the statements of the three problems of Chapter 1, the suggested 
scaling factors were given. Had they not been given, show how the techniques 
described in this chapter could have been used to establish them. 


2-9. In Figure P2-9, x is the displacement of the mass as measured from 
its normal position with zero force f. 


FIGURE P2-9 
Ib * ' 
M=0.1 iaulnec? (equivalent to 38.6 lb of weight) 
= 40) eee: 
in. 
EP ae 
in./sec 


At ¢ = 0, a step function of f equal to 50 lb is applied. Prepare a properly 
scaled program to represent this case on a real-time basis. Assume a reference 
voltage of either 10 or 100, whichever is preferred. State which you are 
using. 

2-10. This is a laboratory problem to be performed if an analog computer 
is available that can be operated in a high-speed-repetitive mode and with 
an oscilloscope display. Use such a method of operation to simplify the trial- 
and-error determination of the interest rate in part (a) of Problem 1-1. 
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2-11. (a) What are the time relations for the signals x and y as developed 
by the program in Figure P2-11, and (b) why does the odd-amplifier rule 
not apply? 


FIGURE P2-11 


2-12. Derive relation (2-13). 


Suggested Reading 


(The following books treat analog computers in considerably more detail 
than has been attempted here.) 
1, A. 8. Jackson, Analog Computation (New York: McGraw-Hill, Inc., 1960). 


2. Z. Nenadel and B, Mirtes, Analogue and Hybrid Computers (London: Iliffe 
Books Ltd. and New York: American Elsevier Publishing Co., 1968) (translated 
from Czech). 


Appendix 2A: 
Developing Linear 
Transfer Functions’ 


In problems of simulation, it is generally not the object to develop specific 
transfer functions, but to model the system being simulated as closely as 
is possible. That is, many block-diagram configurations and resulting 
computer programs may be developed to represent a given transfer function; 
the one that should be used in the simulation program is the particular one 
that follows the cause-and-effect relationship existing in the system being 
simulated, This is not necessarily the simplest or “canonic,” form. 

There are some instances, however, when direct modeling is not 
required and a particular transfer function is to be represented. If the 
transfer function is linear and rational (does not involve distributed para- 
meters), it can be expressed as a ratio of polynomials in s of the form 

Hs) _ ay8" + ay 8"! + + ays + a, (2A-1) 
x(s) s+ bs"! +--+ +b,5 + 5, 
(It should be noted that the highest power of s in the numerator cannot be 
higher than that of the denominator. If it were, the system would have an 
amplitude response that approached infinity as the frequency approached 


6Acknowledgement is due to Mr. Frank J. Hannigan, a graduate student at the 
University of Connecticut and an engineer with the General Dynamics Corp., who suggested 
the inclusion of this material and the particular tutorial approach that has been followed, 
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infinity, This does not occur in physical systems, and such a transfer function 
would indicate that some response lags had been neglected. It could not 
be simulated without noise problems—the “pure” derivative program of 
Section 2-7 is an example. In many instances, the a coefficients of higher 
order will be zero.) 

A new variable is defined as 


1 
2(s) ES) RUE enor CES jae) (2A-2) 
This may be rewritten in the time domain as 
in nm) d 
Fatt) = x0) = (6.9 4 $b, £4 b))20) — 2A-3) 


The block diagram for developing z(t) is shown in Figure 2A-1. By com- 
bining relations (2A-1) and (2A-2), it may be determined that 


YS) = (4, 8" + ay _8"* + +++ ++ ays + ay)2(s) (2A-4) 


n integrators 


FIGURE 2A-1 
or, in the time domain, 
in n~1 d 
WO = (455 + Ste bab tay) AS) 


All the derivatives of z(t) appearing in relation (2A-5) are available in the 
block diagram of Figure 2A-1; hence the complete block diagram for obtain- 
ing y(t) is as shown in Figure 2A-2. The analog or digital program used for 
simulating the transfer function may be based on this block diagram. Note 
that integration operations are required for this n-state system. 
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FIGURE 2A-3 


As an example, consider the function 
2@) se 
x(s) ss? + 85 ++ 4 
Here n = 2 and 
a,=0 a,=1 a =1 


Chap. 2 
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The block diagram for this relation that corresponds to Figure 2A-2 is 
Figure 2A-3. The analog program would be as shown in Figure 2A-4. How- 
ever, it should be noted that entirely different block diagrams, shown in 
Figure 2A-5, could also have represented this transfer function. 

Ordinarily, the configuration selected for developing a simulation 
program will be the one that matches most closely the actual cause-and- 
effect relationship in the system being simulated. 


x(t) 


FIGURE 2A-4 


x(t) 


x(t) 


(b) 
FIGURE 2A-5 


be 


1 
4 
| 


Linear Simulation Operations 
with Digital Computers 


3-1 Computer Languages Used for Simulation 


When establishing a digital computer program, a choice always exists be- 
tween (1) direct machine languages, and (2) a user-oriented language such 
as Fortran or Algol. The latter alternative may prove somewhat less effi- 
cient in the use of the computer from the standpoint of both economy of 
elements and speed of execution. It is, however, simpler, as far as the pre- 
paration of the program is concerned, in the sense that there is a smaller 
likelihood of programming errors and (in consideration of compiler error- 
detecting features) a better chance to detect such errors in the initial pro- 
gramming. 

When a simulation program is to be used frequently, as when it is to 
be part of a working system rather than simply for the purpose of system 
analysis and synthesis, machine language generally is justified. The const- 
ruction of such a program requires the services of an expert programmer 
fully acquainted with the particular computer to be employed. In such appli- 
cations, special-purpose computers designed for this particular type of pro- 
gram are often used. Even when this is the case, the preliminary runs of the 
prototype program would probably be conducted in terms of a user-oriented 
language, because such a language is not only easier to devise but also easier 
to modify. It will not be assumed here that the reader is acquainted with 
machine-language programming. 
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In this book, a knowledge of some user-oriented language will be 
assumed instead. Such languages are applicable to general-purpose com- 
puters that employ a compiler to translate the user-oriented language into the 
language of the machine in the form called an object program. As such 
object programs may be stored on cards, tape, disk, or magnetic drum, 
they can be reemployed at various times with various data. Therefore, in a 
sense, the slower execution time when a user-oriented language is employed 
results partly from the time required for compilation and assembly. This 
time, however, applies only to the first run of a given program; compilation 
and assembly need be repeated only if the program instructions should be 
modified. For repeated runs after the compilation is performed, the computer 
operates directly from the stored object program, and the only time required 
in addition to actual execution time is that required to place the object 
program in storage (i.e., to load it), This loading time need be repeated only 
if the object program has been removed from the computer to free it for other 
work. As far as actual execution time is concerned, the program arranged 
from a user-oriented language is only slightly less efficient than a machine- 
language program prepared by a highly skilled programmer and is likely 
to be more efficient than one prepared by a programmer who is less skilled. 

The discussion here, therefore, will be on the basis of user-oriented 
languages, but no specific language will be referred to except for a few iso- 
lated examples. When methods are compared on the basis of execution 
times, these times will not include the times required for compilation or 
loading. 

The current most well-known user-oriented languages are Fortran and 
Algol in their various varieties and levels of sophistication. However, new 
and more versatile languages, such as PL/1, are being introduced. Hence, 
for the sake of generality and to guard against obsolescence, discussions 
here will be in terms of general flow diagrams rather than in terms of specific 
languages. 


3-2 Basic Linear Operations 


In linear simulation problems to which we have been confined up to now, 
the only computation operations (as distinguished from input and output 
operations and decisions concerning them) that need be performed are 


1, Addition and subtraction. 

2. Multiplication and division by a constant. 

3. Integration with respect to the basic independent variable. 

4. Differentiation with respect to the basic independent variable. 
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The first two of these operations are straightforward and require no 
explanation. In general, the numerical quantities representing either program 
parameters or variables will be expressed in floating-point (real) rather 
than integer (fixed-point) form. Only in those special instances where 
variables are quantized will integer forms be employed. 

Integration and differentiation with respect to the independent vari- 
able are not straightforward operations with digital computers; their imple- 
mentation is more complicated than with analog computers and will require 
special treatment in this chapter. 


3-3 Methods of Integration with Respect 
to the Independent Variable 


Many methods of digital integration have been proposed and employed, 
this being one of the subjects treated within the field of numerical analysis 
and specifically within the area of the subject, numerical integration. The 
reader is warned, however, not to become confused or misled when examin- 
ing this area. A tremendous number of numerical-integration techniques 
have been proposed; in many instances the same technique is given a number 
of different names. For example, what has been described in Chapter 1 as 
simple rectangular integration is also called Euler’s method, the point-slope 
method, and the first-order Runge-Kutta method. 

The reader is also warned that many proposed techniques of numerical 
integration, convenient though they might be for other computational 
purposes, are not suitable for simulation. In simulation problems each 
iterative step of the independent variable, At,! requires a computation of 
the integral over the range Art. However, the integrand is known only at 
the beginning and before the beginning of this range. The value of the inte- 
grand at the end of the range can be determined only after the integral 
itself has been established. 

To facilitate this explanation the general problem is considered where 
the integration to be performed is, for example, 


y(t) = f x@ at (3-1) 


The integrand x(f) is, in turn, a function of y(t) and other functions of time, 
i.e., 


x() = f{y@), 4] (3-2) 


1The discussion of this chapter is conducted on the basis of time, ¢, being the basic 
independent variable. Of course, there will be simulation problems in which the basic 
independent variable will be some other quantity. 
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The functional relationship described by (3-2) is not generally analytic or 
algebraic. It is obtained by tracing the feedback loop of the block diagram 
to determine how y(t) affects x(t). 

Since it will be necessary to work in terms of finite Av’s when a digital 
computer is used, it is convenient to express y(t) as y(n), where 


t=nAt (3-3) 


This obviously implies that y will be known only at discrete instants of time, 

at the end of the At intervals. Similarly, x(¢) is described as x(n). The inte- 

gration problem presented by relation (3-1) may then be restated as 
t=(n+1) At 


vat =v + fo” xOar (3-4) 


t=n at 


when being carried out over a single interval, Ar. 

In simulation the difficulty arises from the fact that x(t) is known 
only for values of ¢ less than n At [i.e., x(n), x(n — 1), x(n — 2), ete., are 
known, but x(n + 1), x( + 2), etc., are not]. Therefore, for simulation 
applications only those techniques that do not depend upon a knowledge 
of x(n + 1) may be employed. A number of such schemes of numerical 
integration have been described in the literature. [1-4]. 

In general, these schemes may be classified in the manner shown in 
Table 3-1. For ease of classification these methods will be grouped in cate- 
gories designated as la, 1b, 2a, 2b, 3a, etc. Before proceeding with a de- 
scription of the various schemes, the terms used in Table 3-1 will be clarified. 


TABLE 3-1 
Techniques (a) Nonextrapolating (b) Extrapolating 
1. Single pass la. Examples: rectangular 1b. Examples: backward- 
integration; Euler’s difference methods 
methods 
2, 3, etc. Multipass 2a, 3a, 4a, etc. Examples: 2b, 3b, etc. Examples: 
(class number refers predictor-corrector; Milne methods 
to number of passes) Simpson’s rule; Runge- 


Kutta methods 


In general, when proceeding with numerical integration, the integrand 
values x(n — 1), x(n — 2), etc., will have been evaluated; similarly, y(”), 
y(n — 1), x(n — 2), ete., will have been established during previous iterations. 
The integrand x(n) has just been established from a knowledge of y(n) by 
traversing the feedback loop (of the block diagram) that relates them. 
The integration procedure now is to determine the value of y(n +- 1). 

In a single-pass technique (1a or 1b), y(n + 1) will be determined directly 
from a knowledge of the previous y’s and the previous x’s. The loop will 
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not then be retraversed to determine the resulting value of x(m + 1) for the 
purpose of correcting the value of y(n + 1) that was just computed. That 
is, there are no first guesses followed by subsequent corrections. 

In a single-pass, nonextrapolating technique (la), only one value of the 
integrand x and one previous value of the integral y will be used to deter- 
mine y(n + 1). Rectangular integration as described in Chapter 1 is an 
example of this. 

In a single-pass extrapolating technique (1b), more than one value of 
the integrand x [e.g., x(n) and x(n — 1)] will be employed in connection 
with some extrapolating formula in order to make a guess as to what 
x(n + 1) might be. This is used, in turn, to establish a better value of the 
mean value of the integrand over the range of integration in order to improve 
the integration accuracy. 

In a multipass technique (2a or 2b), a first guess will be made of the 
value of y(n +- 1) using one of the single-pass techniques. Then the feed- 
back loop will be traced again, to determine the corresponding first guess of 
x(n + 1). This may then be used for a second more accurate integration, 
more accurate because at least an estimate of x(m + 1) has been established 
and the accuracy of the integrand may be improved. If the procedure is 
terminated at this point, it would be called a two-pass technique. If repeated 
to obtain still greater accuracy, it would be described as three-pass, four- 
pass, etc. 

In a multipass nonextrapolating technique (2a, 3a, etc.), the procedure 
just described is employed without making use of the extrapolated values 
of x based on x(n — 1), x(n — 2), etc. These techniques are generally referred 
to as Runge-Kutta methods. 

In general, the more complicated the method, the greater the accuracy 
that will be obtained for a given iteration interval; conversely, a larger 
iteration interval will be permissible for a required degree of accuracy. 
However, the more complicated the technique, the greater the time required 
per iteration interval. Hence it does not always follow that the more sophis- 
ticated techniques will lead to the shortest total execution time. This question 
will be discussed further, but first the details of the various numerical- 
integration techniques adapted to problems of simulation will be explained. 


3-4 Type 1a—Single-Pass Nonextrapolating 
Numerical Integration 


Only two techniques within this category are of particular interest in simula- 
tion problems. The first is the simple rectangular-integration procedure 
described in Chapter 1, where 


y(n + 1) = y(n) + x(n) At (3-5) 
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This will be referred to here as method la-1. It has been explained in geo- 
metric terms in Figure 1-29. 

The second technique is similar, but it is based on using the previous 
value of the integral, or y(n — 1), rather than y(n). The relation employed is 


y(n + 1) = y(n — 1) + 2x(n) At (3-6) 


This will be referred to as method la-2. Its geometric significance is shown 
in Figure 3-1. This method has the apparent advantage that the value of the 
integrand employed is that at the middle of the interval rather than at the 
beginning. It often is referred to as the modified Euler method. It does present 
starting difficulties since, to determine (1), »(—1) will not be known. Hence, 
in the first iterative step only, method la-1 is employed. However, it can 
be shown that when used in the simulation of a component in a feedback 
loop, an unstable solution will always result. Therefore, it is mentioned as 
a matter of record; its use is not advocated. 


x(t) X(t) vs. t 


Correct integral is the area abcde; 
computed integral is the area of the 
rectangle fbgde; error is (area beg 
area baf )(no error when area beg 
equals area baf) 


nt 
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FIGURE 3-1 


3-5 Type 1b—Single-Pass Extrapolating 
Numerical Integration 


Because in simulation problems future values of the integrand will not be 
known prior to the integration’s being completed, any estimate of these 
future values that might be obtained by means of extrapolating techniques 
must depend only upon the present and previous values of the integrand; 
hence such extrapolating procedures depend upon backward differences. 
Such backward differences are defined by the following relations and sym- 
bolism: 


Vx(n) & x(n) — x(n — 1) 
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V*x(n) A Vx(n) — Vx(n — 1) 
x(n) — 2x(n — 1) + x(n — 2) (3-7) 
etc. 


Two widely employed extrapolating techniques are based on the assumption 
that the integrand x can be represented approximately by a polynomial in 
t of order m. Then, if values of x are known at (m +- 1) values of f, the poly- 
nomial relationship can be established. This may be used in turn to establish 
an integral over the iteration interval based on this analytic relationship. 
The details have been developed in a number of textbooks dealing with 
numerical integration. In general, these are based on Simpson’s rule. One 
of the most basic techniques, related to method la-1, is as follows: 


(n+ 1) = y(n) + At [x(n) + 4 Vx(n) + fy V?x(n) 
+ $V?x(n) + 354 Vix(n) +--+] (3-8) 
This technique, also described as Adams’ method, will be described as 
method 1b-1. The extrapolation may be carried out to any order desired, 
the order being described as the highest order of V employed. Ordinary 
rectangular integration, method la-1, is simply the zeroth-order version of 
this method. Figure 3-2 explains this technique geometrically for the first- 
and second-order cases. 
Just as with the type 1 technique, a modified version has been proposed 
based on starting form y(n — 1) rather than from y(n). The relation is 


y(n + 1) = y(n — 1) + 2 At x(n) 
+ SEpyax(n) + Vex(n) + VEx(n) ++] 


a a [V*x(n) + 2V5x(n) + 3V8x(n) + +++] (3-9) 


This technique will be described as 1b-2. It has the apparent advantage 
common with la-2 that the integrand over the middle of the interval is 
employed. However, as was the case with method la-2, this method also 
“blows up” when it is used for the simulation of an element appearing in a 
feedback loop. The addition of the extrapolation feature causes this insta- 
bility to appear sooner and to be more extreme than with la-2. The use of 
this method is therefore not advocated. 

Extrapolating techniques will introduce starting difficulties as, for low 
values of n, not all the necessary backward differences, or V terms, can be 
established. Hence, when employing method 1b-1, it is necessary to use a 
zeroth-order version (simple rectangular integration) for the first iteration, 
a first-order version for the second, etc., until enough iterations have been 
executed to accommodate the order of extrapolation desired. 

These extrapolating methods are suspect when simulating systems 


oN 
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x(t) 
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correct integral is the area 
bede; computed integral is the 
area bfde; error is the area 
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(a) first-order extrapolation 
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(b) second-order extrapolation 


FIGURE 3-2 


(n +1) At 


where sharp discontinuities of the x(t) versus ¢ relationship might occur. 
This can be the case, for example, in mechanical systems when backlash 
and friction are present, or in any type of system subject to sharp limiting, 
as in linear-programming problems. In such instances, previous values of 
the integrand are better ignored. If improved accuracy per iteration is 
required, going to one of the multipass nonextrapolating techniques (types 
2a, 3a, etc.) might be preferred. 


3-6 Type 2a, 3a, etc.—Multipass Nonextrapolating 
Techniques of Integration 


These methods generally are called predictor—corrector or Runge-Kutta 
methods. Their general philosophy is illustrated by a two-pass technique 
described here as method 2a-1. The steps are as follows: 
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y,(n + 1) = y(n) + x(n) At (3-10a) 
x,(n + 1) =f[y,(2 + 1), (+ 1) (3-10b) 
yn + 1) = yn) + $ At (x(n) + x,(n + I] (3-10c) 
x(n + 1) = f[y(n + 1), ta + 1) (3-10d) 


Of the four basic steps represented by these equations, the first is simply 
method la-l, or simple rectangular integration; it is used to obtain the 
first guess or predicted value of y(n + 1), hence the p subscript. This first 
guess is then employed in a second traversal of the feedback loop to obtain 
the corresponding predicted integrand value, x,(n + 1). This second step 
is represented by the functional relationship (3-10b). Then, corresponding 
to relation (3-10c), a second, final evaluation of y(n + 1) is made by using 
the trapezoidal formula for integration. This formula is similar to rectangular 
integration with, however, the value of the integrand employed being the 
mean of the initial, x(n), value and the predicted, x,(n + 1), final value. 
Finally, corresponding to the functional relationship (3-10d), the feedback 
loop is traversed the second time for this iteration (the second pass) to deter- 
mine the corrected value of x(n +- 1) so that it may be available for the next 
iterative step. In general, it may be noted that twice as many relations are 
needed to describe the process as there are iterative passes. 

This technique has been variously referred to as the improved Euler 
method, the predictor—corrector method, and the trapezoidal method. Another 
two-pass method has also been proposed that commences by progressing 
only one half of a At interval during the first pass, and then the second half 
of the interval during the second pass. Just as other techniques have some- 
times been named, this is also frequently referred to as the modified Euler 
method. The steps employed in this method, to be referred to here as method 
2a-2, utilize the predicted value of the integrand at the middle of the itera- 
tion interval. The steps are 


v(m -+ 4) = y(n) + x() 4 (3-11a) 
x,(n+ = flyin + Pan + D) (3-116) 
y(n + 1) = y(n) + x,(n + 4) At (3-11¢) 
xn + =f + Dott DI (3-114) 


Methods 2a-1 and 2a-2 both employed two passes. More passes can 
be used for still greater accuracy for a specified interval At. Such procedures 
are generally described as Runge-Kutta methods. An example of a three- 
pass technique is the Simpson’s-rule method, classified here as method 3a-1. 


y(n + 4) = y(n) + At x(n) (3-12a) 


x(n + 4) =f[y,(n + 4), tn + 4) (3-12b) 
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yn tl=y,nt H+ Aix int) (3-120) 
xn+ 1) =fly,0 + 1),t +) (3-124) 
vn + 1) = y(n) + AEE) + 4xin +) + x,2+ D] G12) 


x(n + 1) = fly + 1), ta + 1) (3-12f) 


What is generally called the Runge-Kutta method involves four passes. 
(It is often referred to as the fourth-order Runge-Kutta method, but it is 
preferable here to reserve the use of the word “order” to the order of extrapo- 
lation that might be employed.) It has the following steps: 


Yn (a +4) = wo) + x(0) (3-13a) 
Xa + 4) =f[¥ pr + 4) t+ dH) (3-13b) 
Yt +4) =) + x,+ hp u (3-13c) 
Xpa(n + 4) =f Ly pala + 4), tn + 4) (3-13d) 
y(n + 1) = y(n) + x,2(n + 4) At (3-13e) 
x2 +1) =fly,@+ 1), 1@+ 1) (3-13f) 
y(n + 1) = y@) + [x@) + 2x,,2 + 4) 
+2xp@tH+xat yl  — Gl3e) 
x(n +1) =fly + 1), (a + 1) (3-13h) 


Simpson’s rule is employed to weight the effects of the various predicted 
values of the integrand, x,,, x,2, and x,. The last pass, relation (3-13h), is 
necessary to find x(n + 1) for use in the following iteration interval. 

There are also Runge-Kutta methods involving still more passes. 
They are rarely employed in simulation applications because the increased 
execution time required is generally not justified in consideration of the 
accuracy that they afford, 


3-7 Types 2b, 3b, etc.—Multipass Extrapolating 
Integration 


Various combinations of type b (i.e., extrapolating) methods and multipass 
methods might be employed. These generally are referred to as Milne 
methods. Only one type will be discussed here, designated as method 2b-1 
and often called the modified trapezoidal method. It combines a first-order 
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version of extrapolating technique, 1b-2 [relation (3-9)], with the two-pass 
approach. 


y,(n + 1) = yr) + At [Fx(m) — 4x — 1] (3-14a) 
x,(n + 1) =f[y,(n + 1), ta + 1) (3-14b) 
yn +1) = y(n) + AE Ex) + x,(0 + 1) (3-140) 
x(n + 1) =f[y(n + 1), (2 + 1) (3-14d) 


3-8 Summary of Methods 


The methods mentioned here are summarized in Table 3-2. The ambiguous 
terminology used to describe these methods is apparent from this table. 


TABLE 3-2 Methods of Numerical Integration 


Type No, Relation No. Typical Name 


la-1 (3-5) Simple rectangular integration 
Euler’s method 
Point-slope method 


la-2 (3-6) Modified Euler method 
Trapezoidal method 
1b-1 (3-8) Backward-difference method 
1b-2 (3-9) Modified backward-difference method 
2a-1 (3-10) Predictor-corrector method 


Trapezoidal method 
Improved Euler method 


2a-2 (3-11) Modified Euler method 

2b-1 (3-14) Modified trapezoidal method 
3a-1 (3-12) Simpson’s-rule method 

4a-1 (3-13) The Runge-Kutta method 


3-9 Numerical Differentiation 


The same general objections arise with the use of differentiation rather 
than integration in digital-simulation problems as occur with analog com- 
puters. The noise problems arising in analog computers have their counter- 
parts with digital simulation, such as oscillatory and often unstable response 
inherent in the simulation method rather than in the system being simulated. 
Work in the field of numerical analysis has established that numerical- 
differentiation techniques are poorly suited to the solution of differential 
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equations; it follows for the same reasons that they are poorly suited to simu- 
lation as well. Furthermore, the use of derivatives will introduce starting 
difficulties at t = 0. 

Hence numerical differentiation will rarely be employed in simulation. 
It will never be used in the applications discussed in this book when the 
operation is part of a closed loop (in the block diagram), since there the 
errors and convergence difficulties can be cumulative. Only when a derivative 
is required in an open-loop situation and cannot be obtained in any other 
convenient way will numerical differentiation be employed. Then the problem 
is to find 


x) = Fy) (3-15) 


One way of finding this derivative is by working backward from relation 
(3-8). By rewriting this relation with the difference terms (V terms) expressed 
in the form of relation (3-7), the result is obtained: 
y(n + 1) = y(n) + At {x(n) + 4[x(n) — x(n — 1)] 
+ y[x(n) — 2x(n — 1) + x(n — 2)] +--+} (3-16) 
If none of the difference terms in relation (3-16) is employed, the algebraic 
solution for x(n) is simply 


x) et (G-17) 


This is the simplest form of numerical differentiation. 
If only the first difference term of relation (3-16) is retained, the alge- 
braic solution for x(n) will be 


x(n) = [2 FD— IM + xn — 1) | (3-18) 


If the second difference term is retained as well, the algebraic solution for 
x(n) will be 


x(n) = pee + 16x(n — 1) — 5x(n — 2)| (3-19) 


Obviously, in the first iteration only relation (3-17) could be used; in the 
second, relation (3-18) could be used, and in the third and subsequent 
iterations, relation (3-19). 


3-10 The # Operator 


When handling ordinary differential equations dealing with continuous 
functions, it is often convenient to employ the operator p to represent the 
operation d/dt; with discrete or difference equations it is similarly convenient 
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to employ an operator, g,? to represent a time advance of one iteration. 
That is, 


x(n + 1) = x(n) (3-20) 
Similarly, 
x(n + 2) = gx(n + 1) 
= algx(n)] = 8°x(n) 
and 


x(n — 1) = g x(n) 


On this basis, integration method 1a-1, simple rectangular integration, could 
be expressed in the following operational form, equivalent to relation (3-5): 


&y(n) = y(n) + At x(n) (3-21) 
or 
y(n) = At 


1 
= pm) (3-22) 
The above relations could be expressed in block-diagram form, as in Figure 
3-3, 


y(n +1) 


x(n) y(n) 


x(n) i Ot y(n) 


FIGURE 3-3 


The operation V, or backward difference, is represented in this form as 
Vx(n) = x(n) — x(n — 1) = (1 — 87!)x(n) 
or 


w -—1 
V=1—g' =f (3-23) 
Also, since V?x(n) is given by 
V2x(n) = [x(n) — x(n — 1)] — [x(n — 1) — x(n — 2)] 
x(n) — 2x(n — 1) + x(n — 2) 
= (1 — 287! + 87?)x(n) 


2The operator g is not the z of the z transform; it bears the same relation to it that p 
does to the Laplace-transform variable s. 
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Feet lemon ein eeu (ese bi 
ve =(1— 8") (35+ ) (3-24) 
Hence algebraic manipulation of g is permissible and, in general, 
= (Ba i 
vn = ( : ) (3-25) 
Method Ib-1, described by relation (3-8), also could have been written 
as 
panes V/f(e—1\ , S/g—1\ 
a(n) = v(m) + Au 1 ++(&- ) { p(t ) 
Seal. 251g = MN. iv 
ais ar tics ra os fo 626 


or in block-diagram form, as in Figure 3-4. The block diagram of Figure 
3-4 could also be simplified by the general principles of block-diagram 
algebra. 


y(n) 


FIGURE 3-4 


3-11 The z Transform 


As is the case with operational methods applied to continuous functions, 
the use of the operator g presents certain difficulties, in that it does not 
automatically take into account the boundary conditions. As with opera- 
tional calculus employing the operator p, the basic modes of response can 
be determined by these operational methods. Then, however, it is necessary 
to assign unknown coefficients to the terms concerned with each of these 
modes and later to find the values of these coefficients so that the stipulated 
boundary values can be met. This can be avoided by the transform approach. 
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When dealing with difference equations, as are involved when iterative 
methods of computation are employed, the z transform [5] is the most 
convenient. 

In this chapter it will be assumed that the reader is acquainted with 
the z transform. However, for the benefit of those readers who are not, 
Appendix 3A presents a brief introduction; it should be read before proceed- 
ing. 

When applying the z transform to difference equations (i.e., the type 
of equations that arise when describing iterative methods of computation), 
use is made of the shifting theorem, restated here: If Z[f(n)] = F(z), then 


Z[f(n + 1)) = zF(z) — 2f(0) 
and 
Z[f(n + 2)] = 2?F(z) — 22f(0) — 2f(1) (3-27) 
etc, 


Hence, for example, relation (3-5), relating to numerical integration method 
la-1, can be transformed to 
zY(z) — zy(0) = Y(z) + At X(z) 

or 

¥(2) = MX) + 20) (3-28) 
This is practically identical in form to relation (3-22), which handles this 
same relationship on the basis of the g operator; the only difference is that 
now, with the transform, the one pertinent initial condition, y(0), has also 
been included. 

One application of this transform method is its use in determining 
the effects of numerical-integration techniques and comparing them with 
the performance of an ideal integrator. As an example, let simple rectangular 
integration, method la-1, again be considered. Its output (integral) has been 
described in z-transform form in relation (3-28). Two types of inputs (inte- 
grands) will be considered. 


Case 1: x(t) =k = constant. Then x(n) = k, and its z transform is 
(see Appendix 3A) 


I= 


kz 
z—1 
Hence, from (3-28), 


Y(z) = k At G cee pate SO 


The inverse transform of this is (again from Table 3A-1 of Appendix 3A) 
y(n) = kn At + y(0) 


100 Linear Simulation Operations with Digital Computers Chap. 3 


or, since n At = t, 

v(t) = kt + y(0) 
for t= nAt only, where n is an integer. On the other hand, the correct 
value of y, (y ideal) is 


Yt) = (i k dt + y(0) = kt + »(0) 


and is identical to the computed value. This simply proves the obvious fact 
that simple rectangular integration produces a perfect result when the inte- 
grand jn)constant. 


Case 2: x(t) = kt. Then, x(m) = kn At and its z transform is 
= Zz 
X(z) = k At cat 
Hence, from (3-28), 


YZ) = We ire => + ¥(0)> 


or 


¥(2) = Kanr| 3 a fe - + YO)—=5 


[The last form of ¥(z) is obtained from a partial fraction expansion, devised 


so that terms would be obtained matching those of Table 3A-1,] Hence, 
from Table 3A-1, 


wo) = Kan 5 — F-| +90) 


or, since n At =f, 

wo = + yo) — Ee 
for t =n At only, with n an integer. On the other hand, the correct (ideal) 
value is 


y(t) = J kt dt + y(0) = x + y(0) 
o 


Hence a cumulative error results, equal to 


vad) = 0) — yt) = E Ate 


A comparison of the ideal and actual integral ore is shown graphically 
in Figure 3-5. 

The same technique could be used to find the integral that results 
from other methods of numerical integration when the inputs (integrands) 
are polynomial, exponential, or trigonometric functions of time. However, 
since in problems of simulation, integrators appear most often in closed- 
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vt) 


x(t) = kt 
ideal or 


(1) 
% computed 


vy 


y(0) 


FIGURE 3-5 


Joop situations, the performance of the various numerical methods in such 
situations is of greater interest. 


3-12 Comparing Numerical-Integration Methods 
in Closed-Loop Situations 


The most useful comparison of the various methods of numerical integra- 
tion would be based on the performance in the actual simulation situation 
being considered. Most such situations, however, will involve fairly compli- 
cated relationships, often with more than one integration operation in a 
loop; multiloop situations also are common. /f the relations are all linear, 
analysis by means of the z transform is still theoretically possible, but it 
becomes impractically cumbersome for all but the most simple situations. 
If, as frequently is the case, nonlinear relationships are involved, the z- 
transform method is inapplicable. Hence any comparison of methods of 
numerical integration in an actual simulation situation must be done on an 
experimental basis. 

A general comparison of numerical methods of integration, however, 
can be performed by using the same test method frequently employed when 
analog-computer integrators are being tested. Here the situation shown in 
Figure 3-6 is simulated, which is simply the block-diagram representation 


v(t) =A sin w,t 


w(t) = A cos w,t 


FIGURE 3-6 
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of a sine-cosine generator. In analog-computer tests, two supposedly iden- 
tical integrators are employed in the configuration represented by the block 
diagram. Two response criteria are then noted: 


1. How the frequency, w, of the actual sinusoidal wave generated 
compares with the correct, or “ideal” value, @,. 

2. The rate at which the amplitude increases or decreases with time. 
Ideally, the amplitude should remain constant at the value 4. 


This sine-wave generator test may be applied to the various methods 
of numerical integration that have been mentioned here for the purpose 
of comparing them. For the simplest example, method la-1 again is con- 
sidered. Applying its relation, (3-5), to the block diagram of Figure 3-6 
results in the relations 


wn + 1) = w(n) — @, At v(n) 
o(n + 1) = v(n) + @, At w(n) 
with w(0) = A and v(0) = 0. 
The z transform is obtained by applying the shifting theorem of rela- 
tion (3-27), 


zW(z) — zw(0) = W(z) — a, At V(z) 
2V(z) — zv(0) = V(z) + @, At W(z) 
or, after substituting the values of w(0) and v(0) and rearranging, 
(z — 1)W(z) + @, At V(z) = Az 
@, At W(z) + (z — I)V(z) = 0 


It is adequate for the purposes of this test to determine the solution for 
only w(t). Solving these simultaneous equations for W(z) results in 


DG 
VW) = Go} + @, AF 


or 


=. Az(z — 1) x 
KO) = race lop oa 
The pole locations for W(z) in the z plane are established most conveniently 
in polar-coordinate form. In general, for a denominator polynomial of the 
form 
D(z) = 27+ bz+e (3-30) 
the poles will be located at 


z, = Jc [+c0s"! (—b/2,/c) (3-31) 


or at 


z= Je exp(+jcos"! We) (3-31a) 
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In other words, the constant coefficient c determines the radius of the pole 
location in the z plane and the ratio —b/2,/c , the angle. This is shown in 
Figure 3-7. 


poles of rational function 
of z with denominator 


2+bzt+c 


FIGURE 3-7 


For this example, referring back to relation (3-29) and employing 
relation (3-31a), the poles of W(z) are found to be located at 


pa sng jr eiyuaeh BE 
z,=/1+ @Ate exp| J cos”! EAC On (3-32) 


It would have been possible to express relation (3-29) in a partial- 
fraction-expansion form and then, by referring to pair (2) of Table 3A-1, 
determine w(n) and, in turn, w(t). This would be somewhat tedious and 
unnecessary; the pole locations just described are alone sufficient to establish 
the application of the test criteria. 

If it is recalled (see Appendix 3A) that the variable z of the z transform 
is defined as 


z=e 


and if s is described in terms of its real and imaginary parts, 


s=o+jo 
then 
Zz = e74t gloat — er 4t/qy At (3-33) 
In other words, 
Jz| = e74 
or 
1 
Ce Inz (3-34a) 
and 
ny : 
o= 5 ez (3-34b) 


When the poles have been determined from a function having the denomi- 
nator in the form of (3-30), this becomes 


ie - In(./e) (3-35a) 
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and 


ek fie, By 
Ol cos ie (3-35b) 


For this particular example of method la-1, where the pole locations have 
been given by relations (3-32), the corresponding s plane location of these 
poles will be 


t 


oS x In,/1-+ (@, Ad? (3-36a) 


and 


= Lh cost 
OT AES TEE@RAN? 


tan! (@, At) (3-36b) 


ar pet @, At 


The computed output, therefore, will be of the form 
w(t) = Ke* cos (wt + 9) for t =n At only (3-37) 


The constants K and ¢ would have to be determined by finding the actual 
inverse transforms of the expression for W(z) appearing in relation (3-29). 
For the purpose of this sine-wave-generator evaluation test, this is not 
necessary. The first test criterion is 


1. The comparison of the actual frequency @ with the desired or ideal 
frequency @,. From relation (3-36b), their ratio is 
@ _ tan”! (@, At) 


@, At 
This ratio should be unity, but it is seen that the frequency of the 
computed signal will be somewhat lower than the ideal [the ratio 
(tan~! x/x) is always less than unity]. Normally, in a practical com- 
putation instance, (co, Af) will be sufficiently less than unity that the 
following approximation (based on the series expansion) may be 
used: 


= x 
tant x=x—> 
3 


so that, approximately, 
21 Gay (3-38) 
a 


2. The evaluation of the time decrement or increment of the amplitude 
of the generated sinusoidal wave. Here it is seen that @ will be posi- 
tive and there will be an increment with time by the factor e”. But 
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t 
e* = exp [a In, /1-+ @, At? Ar | 

= exp {In [1 +- (@, At)?}"?4%} 

= [1+ @,anry™ 
One period of oscillation will be 7 = 2z/w or, approximately, 
2z/w,. Substituting this for ¢ yields the perunit amplitude increment 
per period as 

em =[l+ (a, At)2yvo4' 


or, from the binomial expansion, 


ua Tu 
2 
eT = 14+ —2 (At) + a. (aya Ma abt 


= 1+ 2(@, At) 4 Si (@, At)*(m — @, At) 4 


If At is sufficiently small so that w, At < 1, the result is approxi- 
mately 
amplitude in given period 
amplitude previous period 
= 1+ 7, At 


per period increment ratio 


or 


=1+22 (3-39) 


At 
tf 
As a specific numerical example, let the case be considered where this 

per period increment ratio may be only 0.1 per cent. Then 


2m At < 0.001 
or 


=> = 20002? = 19,800 
5 


That is, for this 0.1 per cent criterion to be met, approximately 20,000 
iterations are required per period of the sinusoidal signal generated. This 
appears to be an excessive number of iterations and the use of more sophis- 
ticated methods of integration certainly would be expected to produce a 
more favorable result. 


3-13 Use of Operator Rather than z Transform 
with Sine-Test Criteria 
For this particular test criteria, the only analysis required was that to estab- 


lish the poles of the W(z) function. This could easily have been performed 
on an operational basis. In the preceding test of method la-1, Figure 3-3 
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could have been used as a substitute for the integration (1/s) operation of 
Figure 3-6; the resulting block diagram appears in Figure 3-8. The loop 
transfer function then is [c, At/(g — 1)]* and the characteristic equation 
is 


(s — 1)? + (@, At)? =0 


v(n) 


w(n) 


FIGURE 3-8 


The roots of this equation produce the same poles on the plane as were 
located on the z plane by relation (3-29). The subsequent conclusions regard- 
ing the sine-wave-generator test criteria are the same. However, it was pos- 
sible to avoid a number of steps by using this # operator and it was no longer 
necessary to specify initial conditions. 

When more sophisticated techniques of numerical integration are 
employed or when a more complicated feedback loop is involved, the tech- 
nique is still applicable in theory, but the characteristic equation in 3 becomes 
of a higher order, and more difficulty is encountered in finding the roots 
that lead in turn to the pole locations in the g plane. As an example of this, 
this test criteria might be applied to method la-2, This method is based on 
relation (3-6) and might be portrayed in block-diagram form as shown in 
Figure 3-9, 


y(n) 


FIGURE 3-9 


The method may also be expressed as a transfer function employing 
the g operator as 


y(n) | & i 
a 2A eo rate (3-40) 


Substituting this expression for the integration operation 1/s in Figure 3-6 
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results in the block diagram shown in Figure 3-10. The characteristic equation 
is based on 


ee (20, Ae y =O 


& 
FHI 


v(n) 


w(n) 


FIGURE 3-10 
and is 
&* — [2 — (2a, At)*]z? + 1 =0 (3-41) 
Here a new operator is defined for ease in finding the roots: 
A= 


The poles of this function, in terms of A, are determined by analogy to rela- 
tion (3-30) as 

A, = JS 1 exp{+jcos~! [1 — 4(2m, At)*]} 
and, since g = +./A, these poles are located in the g plane at 

&, = +1 exp{+jt cos! [1 — 2(@, Ar)*]} (3-42) 
These pole locations are pictured in Figure 3-11. Since all these poles are 
on the unit circle of the g plane, |g,| = 1, it follows from (3-34a) that in 


the s plane they are located at o = 0. Hence it may be concluded that the 
sine waves developed will have neither a decrement nor increment and the 


yPlane 


unit circle 


ed 4 cos“! [1 — 2(w, An?) 


FIGURE 3-11 
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second test criterion is met perfectly; a constant-amplitude sine wave is 
produced. 
In Figure 3-11, the angle vy may be expressed approximately in a series 
form as 
v = 4cos~! [1 — 2(@, At)?] 

= 4{2[2(@, At)*] + 4[2(@, At? + #s[2@, AN?P + ++}? 

= @, At {1 + 4[2(@, At)*] + gyl2(@, Aty?P + ++}? 

= @, At [1 + {(@, An)*) approximately 
Hence, from relation (3-34b), the actual frequency of the computed sine 
wave in this sine-wave-generator test based on the pairs of g-plane poles 
at the angles +-v will be approximately 


o, = Be — afl + Xo, An] (3-43) 


The other pair of poles are located at the angles z + v, or approximately 
at 2. These will result in a spurious high-frequency oscillation of frequency 


_ [& _% 3 
ORE ay Gee) 


This second, higher, frequency has a period 22/@, equal to 2 At and shows 
that there will be a spurious oscillation of a period equal to twice the period 
of iteration. The magnitude of this oscillation depends upon how the com- 
putation is started (recalling that method 1a-2 is not self-starting). In any 
event, such oscillations will not die out. 

The basic frequency is given by relation (3-43), and it may be seen to 
be related to the ideal frequency @, by the ratio 


@, _ 2 
2 — 1+ Yo, A0) 


If this is compared with relation (3-38), based on the application of this same 
test criterion to method la-1, it may be seen that the frequency error is only 
one half as great with this second method. More important, when comparing 
it with the previous method, there is now no time increment or decrement in 
amplitude. In general, this test would seem to show that the second method, 
la-2, is far superior to la-1. 

It can be shown, however, that for the simulation of many other feed- 
back situations, this method of numerical integration, 1a-2, can lead to insta- 
bility. Consider, for example, the simulation of the situation shown in 
block-diagram form in Figure 3-12. The g-operator criterion, applied for the 
case where method la-2 was employed, would indicate clearly that instability 
would result. The proof of this is left to the reader as one of the problems 
suggested at the end of the chapter. This instability could, of course, be 
demonstrated by actual computer simulation of the problem shown in Figure 
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FIGURE 3-12 


3-12, with method la-2 chosen for the numerical integration. It is because 
of this tendency toward instability that method la-2 is not recommended 
for simulation in feedback loops. 

The sinusoidal test procedure described could be applied to still more 
sophisticated methods of numerical integration; however, the mathematical 
analysis becomes still more cumbersome. For this reason, the use of this 
criterion by actual simulation studies on a computer may be more feasible 
than z-transform or g-operator methods of analysis. However, as the pre- 
ceding example relating to Figure 3-12 showed, the sinusoidal criterion alone 
is not conclusive in regard to the predicted stability of the method. 


3-14 Implementation of the Various Methods 
of Numerical Integration 


Figure 1-27 showed a general flow diagram illustrating the procedures that 
might be employed in a simulation problem. Step (e) of that diagram repre- 
sented the numerical-integration operation itself. This operation is handled 
most conveniently by calling a subroutine (procedure) that executes the 
desired integration operation for that interval. Different subroutines, corre- 
sponding to the various methods listed in Table 3-2, could be called to permit 
a change in the method selected without requiring any alteration of the 
main program. 

Some of the more sophisticated numerical-integration methods will 
require more operations than were shown in Figure 1-27, With methods 
that present starting problems, the number of the iteration must be known. 
For example, with a fourth-order extrapolating technique it is necessary to 
use the zeroth-order version of integration for the first iteration, the first- 
order version for the second, etc., until finally, at the fifth iteration, all orders 
of backward differences are available and can be employed. Hence a quantity, 
labeled here ITERATIONS, must be set initially to unity by the main pro- 
gram and then progressively advanced by the integration subroutine itself. 
With multipass methods of integration a logical variable also should be used, 
called here LASTPASS, that informs the main program that the last pass of 
the integration procedure has been completed; only then would data be 
printed or stored for printout. Also, with multipass methods time is advanced 
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(by amounts equal to Ar or At/2) only during some of the passes; following 
such time advances, then and only then should input functions (e.g., 
XFUNCTION in the Chapter 1 example) be looked up to determine the new 
values of the time-dependent input variables. For this purpose, another 
logical variable, called here NEWTIME, is introduced. For example, with 
the Runge-Kutta method 4a-1 and relation (3-14), time is advanced only 
during the first and third of the four passes; only after these passes is it nec- 
essary to call the subroutine(s) that provide the new inputs (e.g., x and x 
in the example of Chapter 1). 

If there are a number of integration operations to be performed, the 
same integration subroutine may be employed for all; the input and output 
variables associated with each integration operation are identified by proper 
subscripts. When applied to the Chapter 1 example, the integration operation 
that develops » from j could be called number 1 and that which develops » 
from j, number 2 (the actual sequence of numbering is unimportant). With 
such a general-purpose integration subroutine, it will be necessary for the 
program to specify the number of states (i.¢., the number of integration 
operations to be performed). This is done by the integer variable, called 
here STATES. For the Chapter | example, STATES = 2. Figure 1-31 is still 
applicable as a general flow diagram for the main simulation program pro- 
vided the following steps are added to the initialization procedure: 


STATES is established (= 2 in the Chapter 1 example problem) 

ITERATIONS = 1 (to start the count of iterations) 

LASTPASS = true (or 1) (to obtain a printout at ¢ = 0) 

NEWTIME = true (or 1) (so that independent input variables 
will be established at ¢ = 0) 

NEWDT = true (or 1) (needed with some types of integration; 
to be explained later) 


The iterative program shown in Figure 1-31 would then be modified in the 
manner shown in Figure 3-13. Some of the symbols used in Figure 3-13 
would, of course, require abbreviating if Fortran was used, because of 
limitations on symbol length. The symbols IN and OUT are arrays of as 
many elements as there are states; they represent the integrator inputs and 
outputs, respectively. These inputs and outputs will generally have other 
names in the main program that are more descriptive of their physical 
significance in the problem being simulated. (In the Fortran language, this 
is handled by EQUIVALENCE statements.) For example, with the Chapter | 
example, IN(1) is §, OUT(1) is », IN(2) is y, and OUT(2) is y. Hence, 
in Fortran language, the following statement would be necessary at the 
beginning of the program: 


EQUIVALENCE (IN(1),YDD),(OUT(1),YD), 
(IN(2),DYDT),(OUT(2),Y) 
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from initialization 
iterative return aed 
parameters 
for new 
run 


Determine the new | ¢.g., CALL 
values of the time- | XFUNCTION 
dependent variables | 1" 
and parameters | Chapter | 
example 


Establish new integrator traversing “loops” 
inputs 


Time 
to print 
i 


Print or store results, 
when desired 


Test 
for end 
of run 


Advance time to print 


CALL INTEGRATE (STATES, ITERATIONS, 
LASTPASS, NEWTIME, T, DT, IN, OUT) 


FIGURE 3-13 
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In the above, both YD and DYDT represent ». However, it is necessary 
to assign different symbols (different core locations) to these to avoid over- 
lapping of arrays (a rather technical but important programming detail). 
In the iterative part of the program, prior to calling the integration subrou- 
tine, it therefore would be necessary to include the statement 


DYDT = YD 


Figure 3-14 is an example of a Fortran IV program used for the Chapter 
1 example. 


C CHAPTER ONE EXAMPLE OF SPRING MASS SYSTEM 
Cc GENERAL PROGRAM FOR USE WITH ANY INTEGRATION 
MODULE 


DIMENSION INTIN(100), INTOUT(100) 
EQUIVALENCE( INOUT(1),Y),(INOUT(2), YD), (INTIN 
1(1),DYDT), (INTIN(2),YDD) 
LOGICAL NEWTIM, LSTPAS, LAST, CAL, NEWDT 
NTEGER STATE 
REAL K,M, INTIN, INTOUT 
1 - READ 100,K,M 
100 FORMAT(3F10.3) 
PRINT 101,K,M 
101 FORMAT(1H1,10X,2HK-,F10.3,6H KG/CM, 5X,2HM-, 
1F10.3,H KG) 
2 READ 103,B,DT,DTPT, TMAX,N, LAST 
103 FORMAT(10.3,F10.5,F10.4,F10.3,110,12) 

PRINT 104,B 
104 FORMAT(15X,2HB,-F10.3,10.H KG/CM/SEC) 

PRINT 105,DT 
105 FORMAT(10X,23HITERATION INTERVAL,DT =,F10.5,5H 

1SECS) 

CAL=. TRUE. 

CALL XFUNC(CAL,T,X,XD) 

CAL=. FALSE. 

STATE=2 

GOVERM=980. /M 

T=0. 

TPT=-.5%DT 

TMAX=TMAX-, 5&DT 

READ 100,Y,YD 

NEWDT-=. TRUE. 

LSTPAS-. TRUE. 

NEWTIM-.TRUE. 

PRINT 102 
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102 FORMAT(1H ) 
PRINT 106 
106 FORMAT(15X,4HTIME, 7X, 1HX,8X,S5HYDD,7X,2HYD, 
19X, 1HY, 8X, 2HFK) 
PRINT 107 
107 FORMAT(15X,4HSECS, 6X, 2HOM, 6X, 7HCM/SEC2, 5X, 6HCM/ 
1SEC, 6X, 2HCM, 8X, 2HKG) 
C ITERATIVE PORTION STARTS HERE 
3 IF(.NOT.NEWTIM) GO TO 4 
CALL XFUNC(CAL,T,X,XD) 
4 FB=(XD-YD)#B 
FK=(X-Y)#K 
YDD=GOVERM«#(FB+FK-M) 
DYDT-=YD 
IF(.NOT.LSTPAS) GO TO 6 
IF(T.LT.TPT) GO TO 6 
PRINT 108,T,X,YDD,YD,Y,FK 
108 FORMAT(10X,2F10.3,F10.0,F10.2,3F10.3) 
IF(T.LT.TMAX) GO TO 5 
IF(.NOT.LAST) GO TO 2 
STOP 
5 TPT=TPT+DTPT 
6 CALL INT(STATE,DT,T,NEWDT,LSTPAS, NEWTIM, INTIN, 
1INTOUT) GO TO 3 
END 


FIGURE 3-14a 


c RUNGE KUTTA INTEGRATION METHOD 4A1 
SUBROUTINE INT(STATE,DT,T,NEWDT,LSTPAS,NEWTIM, 
iene) 
DIMENSION X(100),Y(100),XLAST(100),YLAST(100), 
1XP1(100),1XP2(100) ,XP3(100) 
LOGICAL NEWTIM,LSTPAS , NEWDT 
INTEGER STATE 
IF(.NOT.LSTPAS) GO TO 205 
CG FIRST PASS 
IF(.NOT.NEWDT) GO TO 203 
HALFDT=.5%DT 
DTOV6=.166667#DT 
NEWDT=. FALSE. 
203 T=T+HALFDT 
DO 204 J-1,STATE 
XLAST(J)=X(J) 
YLAST(J)=¥(J) 
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204 


301 
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IF(ABS(X(J)).GT.1.B-20)Y¥(J)=¥(J)+HALFDT#X(J) 
LSTPAS=. FALSE. 

NEWTIM=.TRUE. 

NXPASS=2 

RETURN 

IF(NXPASS-3 )206 , 208,210 

SECOND PASS f 
DO 207 J=1,STATE 

XP1(J)=X(J) 
IF(ABS(X(J)).GT.1.E-20)Y(J)=YLAST(d )+HALFDT#X(J) 
NEWTIM=. FALSE. 

NXPASS=3 

RETURN 

THIRD PASS 

T=T+HALFDT 

DO 209 J=1,STATE 

XP2(J)=X(J) 
IF(ABS(X(J)).GT.1.E-20)¥(d)=YLAST( J )+DT#X(J) 
NEWTIM=. TRUE. 

NXPASS=4 

RETURN 

FOURTH (LAST) PASS 

DO 211 J=1,STATE 
XP3(J)=XLAST(J)+2.#XP1(J)+2.#XP2(J)+X(J) 
IF(ABS(X(J)).GT.1.E-20)¥(J)=YLAST(J )+DTOV6#X(J) 
NEWTIM=. FALSE. 

LSTPAS=.TRUE. 

RETURN 

END 

RAMP FUNCTION SUBROUTINE 

SUBROUTINE XFUNC(CAL,T,X,XD) 

LOGICAL CAL 

IF(CAL) GO TO 1 

X=ReT 

RETURN 

READ 300,R 

FORMAT(F10.3) 

PRINT 301,R 

FORMAT(15X,32HX IS RAMP FUNCTION WITH SLOPE OF, 
1F10.3,7H CM/SEC) 

XD=R 

RETURN 

END 


FIGURE 3-14b 


SUBROUTINE INTEGRATE (STATES, t, At, IN, OUT) 


STATES is an integer 
IN, OUT are arrays of 
dimension, STATES 


DO for j = 1 to STATES 


OUT (j) = OUT (j) + At * IN (j) | relation (3-5) 


RETURN 


FIGURE 3-15 


SUBROUTINE INTEGRATE (STATES, NEWDT, t, At, IN, OUT) 


NEWDT is logical (or single bit) 


false or 0 


DO for j = 1 to STATES 


TEMP = LASTOUT (j) 
LASTOUT(j) = OUT(j) 


true or 1 


DO for; = 1 to STATES 


LASTOUT (j) = OUT (j) 
OUT (j) = OUT (j) + At * IN (j) 


y(n- 1) 
saving y(n) 


OUT (j) = TEMP + TWODT *IN (j) 


relation (3-6) 


RETURN RETURN 
FIGURE 3-16 
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SUBROUTINE INTEGRATE (STATES, ITERATIONS, At, t, IN, OUT) 


[backward differences represented 
by symbol V IN (L, j), , meaning 
Vv *(IN;)] 


REAL IN, LASTIN, 
LASTVIN 
INTEGER STATES 


DOfor L = 1 to4 


DO for j = 1 to STATES 
S VIN(L,j)=0 


DO for j = 1 to STATES 


LAST VIN(1, J) =V INC, ij) 


VINA, IN(j) — LASTIN()) 
LAST V IN(2, VIN(2, j) 
[ vING =O | VIN(2, VIN(1,j) — LAST IN(1,j) 


LAST V IN(3, j) =V1N(3, j) 
V ING, j) =V IN(Q2, j) — LAST IN(2, j) 
V IN(4, j) = VIN(3, j) — LAST IN(3, j) 


» ITERATIONS = 2 backward 


differences 
now 
established 


1 toSTATES 


LASTIN(j) = ING) F 
OUT(j) = OUT(j) + At [INGj) + 5VINC, j) + SVING, i) 


+ 2VING, j) +335-VING, dl 


relation 
(3-8) 


RETURN 


FIGURE 3-17 
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SUBROUTINE INTEGRATE (STATES, ITERATIONS, t, At, IN, OUT) 


REAL IN, LASTIN, LASTVIN [backward differences repre- 
INTEGER STATES sented by symbol, V IN(L, j), 


meaning .V '(INj)] 


<at> . 


DOfor L = 1 to 4 DOfor j = 1 to STATES 
DO for j = 1 to STATES 
rend een 


VIN (1, j)= ING) — LASTING) 
- LAST VIN (2, i) =VIN (2, )) 
VIN (2, j) =VIN (1, j) — LASTVIN (1, 3) 
VIN (3.j) 
VIN (2, j) — LASTVIN (2, i) 
VIN (4, j) =VIN G, i) — LASTVIN (3, j) 


DO for j= 1 toSTATES backward 
differences 


now 
established 


DO for j= 1 to STATES 


LASTIN (j) = IN Gi) 
LASTOUT (j) = OUT (i) 


OUT (j) = OUT (j) + Ar * IN (j) TEMP = LASTOUT(j) y(n—1) 
LASTOUT(j) = OUT()) y(n) 
LASTIN(j) = IN(j) x(n) 


ITERATIONS = 2 


OUT(j) = TEMP + TWODT#IN(j) 
+ DTOV3*« (VIN(2, j) + VIN(3, j) 
+VIN(4, j)) — DTOV90* V IN(4, j) 


DTOV90 = Ar/90 


relation (3—9) 


RETURN RETURN 


FIGURE 3-18 


118 Linear Simulation Operations with Digital Computers Chap. 3 


SUBROUTINE INTEGRATE (STATES, LASTPASS, NEWTIME, t, At, NEWDT, IN, OUT) 
NEWDT, LASTPASS, NEWTIME 
are all logical (or single bit) variables 


was previous 
false or 0 pass through 
this subrou- 
tine the last? 


true or | 


first pass 


second pass 


DO for j = 1 to STATES 


OUT (j) = LASTOUT (j) + HALFDT* 
(IN (j) + LASTIN (j)) 


true or | false or 0 


HALFDT = At/2 
NEWDT e 


DO for j = 1 to STATES 


relation (3—10c) 


saving x(n) 
and y(n) time is not ad- 
vanced during 


second pass 


LASTIN(j) = ING) 
LASTOUT(j) = OUT(j) 


OUT(j) = OUT(j) + AT#IN(j) 


time advanced during 
first pass 


relation 
(3—10a) 


to notify main program to notify 
= that new time-dependent main program 
NEWTIME = true variables should be es- computancn 
tablished of new time- 
dependent 
f NEWTIME= false | variables 
to avoid having the ten- nOCheten 
tative first-pass results oe 
LASTPASS = false printed and to assure y 
to inform 


reentry to subroutine 


will be to second pass main program 


iteration is 


LASTPASS = true 


RETURN complete and 
main program then performs the to assure reentry 
equivalent of relation (3—10b) RETURN to first pass of 

subroutine 


[main program then performs the 
equivalent of relation (3—10d)} 


FIGURE 3-19 


Sec. 3-14 Various Methods of Numerical Integration 119 


SUBROUTINE INTEGRATE (STATES, LASTPASS, t, At, NEWDT, IN, OUT) 


LASTPASS and NEWDT are logical 
(or single bit) variables 


false 


first pass second pass 


DO for j= 1 to STATES 
OUT (j) = LASTOUT (j) + AT*IN(j) 


relation 
(3-1 1c) 


LASTPASS = true 


DO forj = 1 to STATES 
LASTOUT(j) = OUT(j) 


OUT (j) = OUT (j) + HALFDT*IN(j) 


iteration 
is 
completed 


saving y(n) 


relation (3—1 la) 


LASTPASS = false 


iteration not 
completed 


time is advanced by Ar/2 
during each pass; hence 

NEWTIME , set to true in 
main program, is not modi- 
fied by this subroutine 


+HALFDT 


RETURN 
(main program effects the equivalent of relation (3—1 1b) after 
the first pass; the equivalent of (3—11d) after the second] 


FIGURE 3-20 
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SUBROUTINE INTEGRATE (STATES, LASTPASS, NEWTIME, t, At, NEWDT, IN, OUT) 


true false 


DO for j= 1 to STATES 


LASTIN (j) = IN(j) 
LASTOUT (j) = OUT (j) 


true Zines false 


OUT(j) = OUT (j) = OUT(j) + (1.SAT)* 
OUT(j) + At *IN(j) IN(j) — HALFDT*LASTIN(j) 


relation (3—14a) 


DO for to STATES 


OUT (j) = LASTOUT(j) + HALFDT* 
(IN (j)+ LASTIN(j)) 


true false 


HALFDT = Ar/2 


NEWDT = false 


relation 
time is advanced (3—14¢) 
& during first 
r=t+Ar 
+ pass time not ad- 
NEWTIME = true re vanced during 
NEWTIME = false second pass 
iteration iteration 
not LASTPASS = false LASTPASS = true | Completed 
completed 
RETURN, RETURN 
[main program then effects [main program then effects 
equivalent of (3—14b)] equivalent of (3—14d)] 


FIGURE 3-21 
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SUBROUTINE INTEGRATE (STATES, NEWTIME, LASTPASS, t, At, IN, OUT) 


true false 


first true false 
pass 


HALFDT = 47/2 
DTOV6 = At/6 
NEWDT = false 


" 
i) 
we 


NEXTPASS 
? 


second 
pass 


DO for /= 1 to STATES 
j=1to STATE tori 
Oia ee tATES PREDIN (j) = IN (j) br aicette 


LASTIN(j) = ING) ae 
LASTOUT(j) = OUT(i) yn) OUT (j)= 
OUT (j) + HALFDT+IN (j) 
OUT(j)= relation (3—12c) 
OUT (j)+ HALFDT#IN(j) 
NEXTPASS = 3 
relation (3-1 2a) t=t+HALFDT 
LASTPASS = false 
NEWTIME = true ELMS 
NEXTPASS = 2 {main program executes 


relation (3—12d)] 


t=1+HALFDT third pass 
DO for j= 1 toSTATES 


OUT(j) = LASTOUT(j) + DTOV6« 
(LASTIN(j) + 4*PREDIN (j) + IN(j)) 


RETURN 


{main program executes 
relation (3—12b)] 


LASTPASS = true 
NEWTIME = false 


relation (3—12e) 


RETURN (main program executes relation (3—12f)] 


FIGURE 3-22 


122 Linear Simulation Operations with Digital Computers Chap. 3 


SUBROUTINE INTEGRATE (STATES, LASTPASS, NEWTIME, t, At, NEWDT, IN, OUT) 


true false 


es 


true 


HALFDT = At/2 
DTOV6 = At/6 
NEWDT = false 


false =2 ened =4 
=3 


second pass 


DO for j= 1 to STATES 
ae ; storing 
PREDIIN (j) = IN (i) xpi (14%) 


OUT(j) = LASTOUT(j) 
+ HALFDT*IN(j) 


first 
pass 


DO for j= 1 to STATES 


storing 
x(n) 
y(n) 


LASTIN(j) = ING) 
LASTOUT(j) = OUT() 


[_OUT()=OUTG)+HALFDT«ING) | relation (3—13c) 


relation (3—13a) 


1=t+HALFDT 


RETURN 


LASTPASS = false [main program executes (3—13d)] 


NEWTIM rue 
NEXTPASS = 2 
t 
RETURN 


{main program executes (3—13b)] 


third pass 


DO for j= | to STATES 


PRED2IN(j) = IN(j) 


fourth pass 
DO for j= 1 to STATES 


storing 
Xp)2 (n + %) 


OUT (j)= LASTOUT(j) 
+ DTOV6+#(LASTIN (j) 
+ 2.*PREDIIN (j) 

+ 2.*PRED2IN (j) + IN (j)) 


OUT(j)=LASTOUT(j)+DT#ING) | 


relation (3—13e) 


fet+HALEDT relation (3—13g) 


NEWTIME = false 
LASTPASS = true 


NEWTIME = true 
NEXTPASS = 4 


RETURN RETURN 
[main program executes (3—13f)] [main program executes (3—13h) 


FIGURE 3-23 
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3-15 Integration Subroutines 


Figures 3-15 to 3-23 are flow diagrams for the nine methods of numerical 
integration that have been discussed. These include two methods, la-2 
(Figure 3-16) and 1b-2 (Figure 3-18), that have not been recommended 
because of unstable tendencies. Nevertheless, these have been included in 
the event that the reader may care to verify that these unstable tendencies 
exist. 


3-16 Comparison of the Execution Times 
and Accuracies for the Various Methods 
of Numerical Integration 


A comparison of the execution times associated with the various numerical- 
integration methods described here that is based on any one particular 
simulation example would not, of course, constitute a general comparison. 
However, it would be roughly indicative of the required execution times 
in general. For that matter, the relative speeds of execution, when comparing 
these methods of integration, will depend somewhat on the computer used 
and the type of compiler and assembler employed, as well as on the simula- 
tion program being handled. 

The program shown in Figure 3-14 was executed on an IBM 360, 
Model 65 computer using a Fortran IVG compiler. The simulation covered 
a problem time (real time) of 0.100 sec. The various versions of the Subrou- 
tine INTEGRATE shown in Figures 3-15 to 3-23 were used, in turn, in con- 
nection with this main program. Results were obtained corresponding to 
those listed in Figure 1-34, The execution times measured did not, however, 
include time required for the actual printing of results (or of storing on 
output tape). Time was measured from when the repetitive iterations began 
up to when they ended before the actual listing of output results commenced. 
The results of such a test are shown in Table 3-3. 

It should be noted that, along with this measurement of execution 
time, a measurement was also made of the root-mean-square (rms) error. 
For the purpose of this error measurement, the output variable » was chosen 
rather than y because it will, in general, display larger error percentages. 
It was possible for this error measurement to be made because the Chapter 
1 example is so oversimplified that an analytic solution of the problem is 
easily derived and included in the program. (This program addition is not 
included in Figure 3-14.) 

The computation of the rms error did not affect the execution times 
listed because the computation of the correct results from the analytic solu- 


ems OS 
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TABLE 3-3* 
Execution Time, rms Error of , 

Method Method No. min ye 
Rectangular la-1 0.07 3.8 
Backward difference 1b-1 0.10 0.055 
Trapezoidal (predictor-corrector) 2a-1 0.14 O11 
Predictor-corrector, modified 2a-2 0.13 O11 
Trapezoidal, modified 2b-1 0.13 0.054 
Simpson’s rule 3a-l 0.20 0,082 
Runge-Kutta 4a-1 0.27 0,004 


*Problem time (tmax) = 0.100 sec; Af = 0.0005 sec; hence 200 iterations are involved. 


tion and the error determination were made after the iterative program had 
been completed. 

It is not possible to extrapolate the results of Table 3-3 to obtain the 
optimum interval At for any required degree of accuracy. This is because 
the relationship between accuracy and At is nonlinear. It is, however, possible 
to specify a given degree of accuracy, such as the permitted rms error in 
and then adjust Ar by trial and error until this desired accuracy is obtained. 
The methods may then be compared on the basis of execution times after 
they each have had their associated iteration interval adjusted to meet the 
accuracy requirement. This was done with the same program, taken from 
the Chapter 1 example. The results obtained are summarized in Table 3-4 
for rms error criteria of 0.1 and 0.01 per cent. 

Methods 1a-2 and 1b-2 have not been included in these comparisons; 
because of their unstable tendencies it was found that they would have been 
unable to maintain any reasonable accuracy requirements regardless of the 
size of the iteration interval. It might be noted that the Runge-Kutta and 


TABLE 3-4 
rms Error of 0.1% rms Error of 0.01% 
Method Required Exec. Required _—_ Exec. 
Method No. At,sec Time, min At, sec Time, min 

Runge-Kutta 4a-1 0.0032 0.05 0,00046 0.28 
Backward difference 1b-1 0.00057 0.10 0.00026 0.19 
Trapezoid, modified 2b-1 0.00067 0.10 0.00021 0.30 
Trapezoidal 2a-1 0.00047 0.13 0.00011 0.54 
Predictor-corrector, modified 2a-2 0,00047 0.13 0.00006 1.12 
Simpson’s rule 3a-1 0.00055 0.18 0.00014 0.72 
Rectangular la-1 0,000012 2.33 not observed— 


time excessive 
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backward-difference methods share the honor of the shortest execution time; 
which of the two results in the fastest execution depends upon the accuracy 
specified. 

The trial-and-error variation of At to obtain a specified accuracy was 
accomplished by the computer itself, employing an implicit program. Such 
programs will be discussed in Chapter 5. The resulting nonround values of 
At would not, of course, be employed in practice. At should always be some 
integer submultiple of the printout interval. For example, if printout is desired 
every 0.002 sec of problem time, as in the example that results in the listing 
shown in Figure 1-34, then At should be either 0.002 sec, 0.001 sec, 0.0005 
sec, etc, Table 3-4 shows that when a 0.1 per cent accuracy is specified with 
the Runge-Kutta method, a Aras great as 0.0032 would be permitted. This is, 
however, greater than the printout interval and hence At would have to be 
reduced to 0.002 sec. Execution time would then be increased from 0.05 to 
0.08 min. 

Although the Runge-Kutta and backward-difference methods appear 
to be roughly comparable with regard to speed of execution, the former 
is preferred whenever dealing with simulation problems involving discon- 
tinuities. Such problems occur quite frequently; they will be discussed in 
Chapter 6. The use of backward differences is always apt to introduce errors, 
rather than reduce errors, when the integrand is not a continuous function 
of time. 


3-17 Use of Operational Modules in Place 
of Numerical Integration 


Sections 2-9, 2-10, and 2-11 and Appendix 2A discuss, for the analog 
approach to simulation, the use of modules to represent transfer functions 
more complex than simple integration (1/s). This general principle can also 
be adapted to digital simulation. The block diagram representing some 
portion of the system being simulated might be simplified, by means of 
block-diagram algebra, to a more compact form. For example, the block 
diagram applicable to the Chapter 1 example, shown in Figure 1-3, could be 
simplified by means of block-diagram algebra to the form shown in Figure 
3-24,3 

This type of simplification is safe only if the user can be sure that there 


3For the purpose of this chapter, the driving displacement in the Chapter 1 example, 
formerly called x, will now be referred to as x;. Similarly, its rate of change will be %. 
This is to avoid confusion with the use here of the symbol x as the general designation for the 
input to any transfer element. For this example, the input signal x would correspond to 
what is shown in Figure 3-23 as the force f. 
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M 


xy 


1 
(M/g)s? + Bs + k 


xy 


FIGURE 3-24 


will be no nonlinear effects involved in the interconnections of the transfer 
blocks involved in the simplification process. In the Chapter 1 example this 
would mean being sure that the spring rate k and the damping effects B 
were truly linear and that no discontinuous effects, such as the engagement 
of limit stops (discussed in Chapter 6), would occur. 

The particular block shown in Figure 3-24 that relates y and f will be 
described as a quadratic lag. Digital procedures will be shown that handle 
this type of transfer operation as one module rather than by successive 
integration operations. In some instances this can result in a substantial 
increase in the speed of execution of the simulation program. 

Such digital procedures are based, fundamentally, on the principle 
of rectangular integration. They can be extended, however, to multipass 
methods, such as Runge-Kutta. They are described most easily by a transient- 
response analysis carried out in the time domain and based upon the assump- 
tion that the input to the block (e.g., fin Figure 3-24) either remains constant 
or varies linearly with time during the iteration interval. As an example, 
let the case of simple integration be considered where the transfer function 
relating input and output is, in operational form, 

1 
f== (3-45) 
If x(t) is considered as constant and equal to x(n) at the start of a given 
(nth) interval, then the time solution for the response will be 
y(t) = y(n) + x(n) At 

where ¢ is measured from the beginning of the interval and therefore equals 
At at its end. Therefore, 

yn + 1) = y(n) + x(n) At (3-46) 
This relation is identical to (3-5), the basis of rectangular integration. 

The handling of the quadratic relationship, such as of y versus f in 
Figure 3-24, is somewhat more complicated. It will be discussed here on a 


more general basis where the input to the block will generally be described 
as x (not to be confused with the x of the Chapter 1 problem) and the output 
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as y. The general form of this quadratic relationship would then appear as 
eS D 
x As?+Bs+C 
(In the Chapter 1 example, A = M/g, B = the B of the example, C =k, 
and D = 1.) For the underdamped case, this transfer relation can also be 
expressed as 


(3-47) 


y _ (GAIN)? . 
x Ss*-+ 200,59 + oF ee) 
where 
(GAIN) = 2 (3-49a) 
bes fs (3-49b) 
Ce It = ios (3-49c) 


@, is the undamped natural frequency and € the damping ratio. These terms 
are applicable when € is less then unity (i.e., the oscillatory case). The more 
general case (where ¢ may be unity or greater than unity) will be treated 
later, If it were assumed that x(t) varied linearly with time over the interval, 
with an initial value x(m) and constant slope x(), the transient solution to 
relation (3-49) is 


30) =k, yn) + ka Ho) + kx EX) 


WO) = ksy(0) + kaw) K kato F kan) 
where : 


ky exp ( Gn, t) ptr sin (@yta/T 0) 


ky = exp (—ben,0)| cos (@,t T=) — spin (0,t,/T= | 

k; = —k,(GAIN) 

ky = (1 — ks)(GAIN) 

ks exp (—te,)| 60s (a, t./T — @) — oon sin (@,t./1 — e)| 
1 


ke = oak 
= {t ee % bs xP (£040) 26 cos (@,t./T — ©) 


4 a sin (0,t,/1=@ ») Gain) 


and ¢ is measured from the beginning of the interval. 
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As interest is specifically in the response at the end of the interval 
when ¢ = At, 


Ha + 1) =e, y(t) + cr 30) + eyx(n) + E,Hn) (3-50a) 
y(n + 1) = esy(n) + eo Hn) + E.x(at) + c4X(n) (3-50b) 


where, in general, c, = k,(At) and, therefore, 


c, = —exp (—Co, A) Si sin (@, At ,/T — @) (3-51a) 


c, = exp (—Co, As)| cos (w, At /1 — ©) 


= ao sin (@, At. /T—@)| (3-51b) 
c; = —c,(GAIN) (3-51c) 
c, = (1 — ¢,)(GAIN) (3-51d) 
cs = exp (—Cm, At)| cos (c, At /T= 6) 

ut ae sin (, At /T=@) | (3-5le) 
Cs= Se (3-51f) 


c= {ar 26 +. exp (—Sen, At)| 26 cos (, At /T= ©) 
+ a sin (@, At. /T— | /~,|(GAtN) (3-51g) 


/ (There is no c,; it would be identical to c,.) 

Although the expressions for the c’s are relatively complicated, they 
need be computed only once, at the start of the iteration. Thereafter they 
will remain unchanged as long as Af is unchanged and only relations (3-50a) 
and (3-50b) need be executed during every iteration. 

The rectangular version of the above relations is based upon the premise 
that, for lack of better information, the value of x(n) is considered to be 
zero; this will be applicable in a number of programs where a direct indica- 
tion of x is not available. The relations then iteratively handled by the 
quadratic module will be 


d(n — 1) =, y(n) + €, ¥(n) + €5x(n) (3-52a) 
y(n — 1) = es y(n) + 6 Hn) + c4x(n) (3-52b) 


The use of such a quadratic module on this basis will be referred to 
as method Qla-1, because of its similarity to rectangular integration, method 
la-1, Figure 3-25 is a flow diagram showing the manner of executing this 
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SUBROUTINE Qla-1(QUADS, ITERATIONS, A, B,C, D, t, At, y, y, x) 
INTEGER QUADS 


DO for j= 1 to QUADS do for all 
quadratic 


modules 
relations Determine: 
(3-49) GAIN (j), &, (/), §(/) 
after 
first 
Determine: iteration 


constants i 4 —_ te 
needediin exp (—w,, Ar), cos(w, Ary 1 —§* ), 


next step | sin (w, Arv/l —{? ) 


relations determine 
(3-51) cy (/) to 


ITERATIONS = 2 


DO for j= 1 to QUADS | do for all modules 


Vrast =P (/) 
PU = ey Ay (/) + cp DPC) + €3()x(/) 


HA) = Cs (AY (A) + C6) Vast — C4) (/) 


RETURN 
FIGURE 3-25 


procedure. It is adapted for handling any number (QUADS) of such quadratic 
transfer functions, each being identified by its (jth) subscript. 

Such a quadratic subroutine would be called by the main program in 
essentially the same manner that the integration subroutines are called, 
shown in Figure 3-22. Such a subroutine would have, however, two outputs, 
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y and y. For the Chapter 1 example, the number of states handled by the 
integration subroutines was two to obtain y and ). With the quadratic module 
only one module is necessary, y and j being obtained in one operation. 


3-18 Modification of the Quadratic Module 
When Input Time Derivatives Are Available 


In many instances, as in the example of Chapter |, not only will an indication 
of the input to the quadratic transfer function [i.e., x(”)] be available, but 
also its time derivative, x(n). In such instances, all the terms of relation 
(3-50) may be employed. The operation is then based on the approximation 
that x varies linearly with time. [Therefore, when x(t) is a ramp function, 
this method is no longer approximate but exact.] In the Chapter 1 example, 
the term corresponding to x(n) in relation (3-50) would be /. From Figure 
3-24 this would be 

f=kx, + Bs, (3-53) 
While an indication of <, is not available in this example, an indication of 
%, is; this could be used as an approximate indication of f by employing only 
the first term in the above relation. The flow diagram of Figure 3-25 would 
then be modified in the sense that the c, term would also be computed during 
the first iteration and that the computation of j(m + 1) and y(n + 1), made 
every iteration, is now based on relation (3-48) where the indication of x(n) 
is employed. This modified form of quadratic module is called here, for 
purpose of reference, method Qla-2. 


3-19 Use of Multipass Methods with the Quadratic 
Module 


Just as much of the error inherent with rectangular integration may be 
substantially reduced by multipass methods, such as Runge-Kutta, multipass 
procedures may be used to advantage with more complicated methods, such 
as with the quadratic module. A Runge-Kutta adaptation to a quadratic 
module will be described here. 

The Runge-Kutta type of relations would be as follows when the time 
derivative of the input, x(#), is not available: 


Fon + 4) = €1,(n) + C2, P(M) + 3,x(n) (3-54a) 
Vorlt + 4) = cs, (0) + 66,301) + C4,x(n) (3-54b) 
Xpi(n + 4) =SLPpln + 4H), Ppln + 4), ttn + H) (3-54c) 
Voalm + 4) = 1,9) + C2, 30) + €3,Xpi(n + 4) (3-54d) 
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Vpa(n + 4) = cs, 9) + 6,3) + C4,Xp1(" + 4) (3-54e) 
Xpaln + 4) =f [Ya + 4), Ips + 1M + 4H) (3-54f) 
Iya + 1) =e, y(n) +c H(m) + C3X p21 + 4) (3-54g) 
y(n + 1) = esy(n) + C6) + €4Xp2(n + 4) (3-54h) 
x,(n + 1) =fly,(2 + 1), 3,2 + 1), t@ + 1) (3-54i) 
Hn + 1) =e, y(n) + e291) + BIx(n) + 2x,(2 +H) 
+ 2x,2( + 4) + x,(n + 1)] (3-54j) 
y(n + 1) = esy(n) + e6 Hn) 4 Six) + 2x,,(n + 4) 
+ 2x,.(n + 4) + x,(n + 1)] (3-54k) 
xa +1) =fb@+ 1, 3@+ 1), ta + 1) (3-541) 


A comparison of the above with relations (3-13) (applying to the Runge— 
Kutta four-pass method of numerical integration) would show that essen- 
tially the same principles are followed here. The c coefficients designated 
with / subscripts are based on the half-interval (i.e., on At/2) when relation 
(3-51) is applied [i.e., At/2 should be substituted for At when employing 
relations (3-51)]. These half-interval coefficients also need be computed 
only during the first iteration. 

A flow diagram for this method, designated as Q4a-1 (the 4 referring 
to the four passes, the “a” to the fact that no interpolation is involved) 
would be based on the same transfer operations as in Figure 3-23. However, 
during the first pass of the first iteration, the c and c, coefficients would be 
established. Then, during each of the four passes, computations based on 
relations (3-54) are performed in the place of relations (3-13) used with the 
conventional Runge-Kutta technique. 

Similar Runge-Kutta type of multipass method could be employed 
with the quadratic module when an indication of x(n) is available. Relations 
(3-54) would then be modified as follows: 


Volt + 4) = C1, VM) + C2, H(M) + C3,x(0) + C4,%(n) (3-55a) 
Vprlm + 4) = €s,H(M) + C6, 2(M) + Ca,x(2) + C5,X(m) (3-55b) 
X20 +4) =Sly pin +b, Ha + P, tn + 4) (3-55c) 
Vyalm + 4) = C,H) + C2, P(m) + €5,x(1) + C4,Xp1(1 + 4) (3-55d) 
Vpalt + 4) = C5,9m) + C6, 3(M) + C4,x(M) + Cg,Xp1(0 + 4) (3-55e) 
Fnt+h) =f a+ P, Ila + Ht + D) (3-55f) 
Fy(n + 1) = ec, y(n) + 2 Hm) + €yx(n) + C4Xp2(0 + 4) (3-55g) 
V(n + 1) = es y(n) + C63) + cgx(n) + CgX,2(n + 4) (3-55h) 
%,(n + 1) = fly, + 1), 3,( + 1), 1 + 1) (3-S5i) 
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Hm + 1) = e,y(n) + ea 3(n) + x(n) 
SRO) + 2 +H) + 2% 2+P) +304] G-S5)) 


yn + 1) = es y(n) + eg P(n) + c4x(n) 
Six) + 2Xp,(n + 4) + 2%,.(2 + 4) +%,(n + 1)] (3-55k) 


x +1) =fly@+ 1), H+ 1), 1 + 1) (3-551) 

x(n + 1) =fly@ + 1), $@ + 1), t@ + 1) (3-55m) 
This technique will be described as Q4a-2. As with Q4a-l, it is based upon 
the weighted average of the varying part of the integrand, in this case x(f), 
over the interval. With input functions x(t) that vary linearly with time, 
zero approximation error would result. 


3-20 Comparison of the Execution Times 
with Quadratic Modules 


The test case, applying to the Chapter 1 example, with the input x,(t), a 
ramp function of time, that was used as the basis of comparison leading to 
Tables 3-3 and 3-4, was also applied to the quadratic modules. A fair com- 
parison can be made with this example only for those methods just described 
as Qla-1 and Q4a-1, For an rms error of 0.01 per cent (corresponding to 
the last two columns of Table 3-4), the observations in Table 3-4a were made. 
Neither of these quadratic methods, based upon a lack of knowledge of 
the x(t) function, appear to have any advantage over the simpler integration 


TABLE 3-4a 
rms Error of 0.01% 
Quadratic Method Required At, sec Exec, Time, min 
Single pass (Qla-1) 0.000018 1.90 
Multipass (Q4a-1) 0.000070 1,58 


procedures listed in Table 3-4, except for the rudimentary rectangular- 
integration method, la-1. 

Such a comparison, unfavorable to the quadratic-module method, 
no longer would apply when there is a knowledge of x(n), so method Qla-2 
or Q4a-2 could be employed. Because the case used for purposes of com- 
parison involved a simple ramp-type disturbance, negligible error exists 
with either of these methods. The iteration interval can be made as large 
as desired; when it was set equal to the desired printout interval of 0,002 
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sec (corresponding to 50 iterations to cover the total simulated time duration 
of 0,100 sec), execution times were 0.09 and 0.26 sec, respectively, for 
methods Qla-2 and Q4a-2. As discussed before, the choice of optimum 
method, and the matter of whether the use of. such a quadratic module 
presents any advantage, depends very much on the system being simulated 
and the type of disturbances to which it is subject. 


3-21 Commonly Encountered Linear Modules 


The example of a quadratic module just described applied only to those 
instances involving an underdamped response ({ < 1). It was only one 


TABLE 3-5 


Transfer Function 
in s Domain 


Numerical Relationship 


Pertinent Coefficients 


1, Simple lag 


woe 
X5)| Dees: 
2. Lead-lag 
X(t) available 
ws) _ Gl + ts 
x(s) 1+ tas 
3. Lead-lag 
X(t) not available 
6s) _ gl + ts 
x(s) 1+ tas 
4, Double integral 
uw) _ G 
x(s) st 
5. Integral with lag 
MS), ae 


x6) «S(- + t8) 


6. Quadratic lag 
Ws) _ D 
xs) As? + Bs +C 
relation (3-45) 


7. Triple integral 
yw) _ G 


xs) 3 


y(n + 1) = €1 y(n) + cax(n) 


y(n + 1) = er) + cox) 
+ ¢3X(n) 


y(n + 1) = er (nm) + crx(n) 
+ ¢3x(n — 1) 


Pn + 1) = Hn) + erx(n) 
vn + 1) = y(n) + c2 Hn) 
+ e3x(n) 


Hn + 1) = e1 Hn) + c2x(n) 
+ ¢3%(n) 
Wn + 1) = y(n) + cay) 
+ ¢3x(n) + esx(n) 
(n) terms omitted when not 
available 


Hin + 1) = e1 x(n) + €2 9) 
+ e3x(n) + cax(n) 

vn + 1) = es y(n) + c6 Hn) 
+ e4x(n) + egx(n) 


Hn + 1) = jn) + erx(n) 
Hn + 1) = y(n) + c2 Hn) 
+ e3x(n) 
y(n + 1) = y(n) + €2 Hn) 
+ ¢4 3m) + esx(n) 


c1 = exp (—At/t) 
cz = Gl — 1) 


c, = exp (—At/t) 
cz = G(l — 1) 
c3 = G At — c2(t, — Ta) 


c, = exp (—At/t) 
2 = Gtn/tn 
c3 = G(1 — ¢1) — c2 


ec. =GAr 

cz = At 

c3 = G(At)2/2 
c, = exp (—At/t) 
cz = Gl — ¢1) 
c3 = GAt—te2 
e4 = (1 — ¢1) 


es = G(At)?/2 — te3 


See Table 3-5a for values 
of c's. 


cy = GAt 
c2 = At 

c3 = Ge4 

c4 = (Ar)?/2 


cs = G(Ar)3/6 
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example of useful module forms for the simulation of linear operations. 
For the general case of the quadratic response, described by relation (3-47), 
the relations for the c coefficients [listed in (3-51) for ¢ < 1] would be modified 
when € = 1 or £ > 1. The general form of quadratic module could still be 
employed; the computation would simply transfer during the first iteration 
only, while the c coefficients are being determined, to a different procedure 
for the computation of these coefficients. 

In addition to the quadratic-transfer function, there are other com- 
monly encountered forms where the module approach might be employed 
effectively. Some examples are listed in Table 3-5, along with the time 
relations and associated coefficients used for progressing from one iteration 
interval to the next. Either a single-pass procedure, such as Qla-1 or Qla-2, 
or a multipass procedure, such as Q4a-1 or Q4a-2, might be employed in 
connection with the modules that are listed in Table 3-5. 


TABLE 3-5a 
6. Details of the quadratic-lag module: 
vs) _ D Extablish G = D/C 
x@) As? + Bs +C On = CA 
¢ = B/2Aop, 
a. The oscillatory case Determine /1 — (2 
t aa | ao = —lon 
@ = On/1 — C2 
Then employ relations (3-51). 
b. The critically damped case c1 = —a} Atexp (—a, At) 
¢=1 cz = exp (—a@, At)(1 — w, At) 
c3 = —(41G 
c4 = G(l — cs) 
cs = exp (—a@y At)(1 + @q At) 


6 = exp (—, At) At 
cy = [At — 2/ap_ + exp (—an At)(2/a, + ANG 


c. The overdamped case Establish =(¢€4+ 7 —Dio, 
¢>1 = —V—Dlon 
Then 


1 = [exp (—At/t2) — exp (—At/t2)I/(t1 — 2) 


Tt 
t 


ae 


ca = [t1 exp (—At/t2) — t2 exp (—At/ti)I(t1 — t2) 
c3 = —Ge, 

cq = Gl — cs) 

cs = [ty exp (—At/t,) — 2 exp (—At/t2)I/(t1 — t2) 
C6 = —T1T2C4 


cg = G{At — ty — t2 + [r} exp (—Al/t1) 
— th exp (—At/t2)\/(t1 — t2)} 
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3-22 Use of the Module Approach to Handle 
Short Time Lags 


Let the situation illustrated by the block diagram of Figure 3-26 be con- 
sidered. If the ordinary procedures of numerical integration are employed, 
the size of the iteration interval At would be dictated by the shortest time 
constant of 0.01 sec; in general, At would have to be considerably shorter 
than this value even with one of the more sophisticated methods, such as 
Runge-Kutta. On the other hand, the long time constant of 10 sec, also 
appearing in the dynamics of the problem, would result in a long settling 
time, and hence there would be interest in the response for an interval that 
was considerably longer than this latter value (e.g., 100 sec). The net result 
would be that many iterations would be required; the execution time of 
what should be a simple problem would be long and the cost high. 


FIGURE 3-26 


The module approach just described could reduce the execution time 
for handling such a simulation problem while permitting some specified 
accuracy of computation of all variables of interest including that which 
varies most rapidly (m). Different module approaches could be employed. 
One technique would be to represent the first block by the single time-lag 
module, item 1 of Table 3-5. Another would be to combine the first two 
blocks into a quadratic transfer function. Then situation 6 of Table 3-5 would 
apply. Referring to the extension of this table, Table 3-5a, the overdamped 
case would be the one applicable. The gain G would be simply k,k,; 7, 
would be 10sec and t, would be 0,01 sec. By employing either module 
technique, much larger iteration intervals would be permissible than if 
ordinary numerical integration were used; the reduction of required execu- 
tion time would be substantial. 

Still other module techniques could be used, of course, to handle the 
type of simulation problem illustrated by Figure 3-26. All the blocks could 
be combined into a single module, eliminating the necessity of a separate 
integration. This would require a third-order module beyond the scope of 
the methods listed in Table 3-5, Its construction should be obvious, however, 
in view of the techniques already described. 

The ultimate limit of the module approach is a single module repre- 
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senting the analytically determined response of the entire system. When 
feasible, this is, of course, the practical thing to do. When the simulation 
procedure is carried out to this extreme, the model apprach no longer is 
employed. Most systems requiring simulation will be too complicated or will 
involve nonlinear elements, so this analytic approach will not be possible. 
Furthermore, after a simulation model has been established for a given 
system, it will often be necessary to add nonlinear effects as afterthoughts. 
Too-extensive use of the module approach (which is based on linear relation- 
ships between the elements involved) “freezes out” such a possibility. In 
summary, when the module approach is practical, as in the example illustrated 
by Figure 3-26, it will permit a substantial reduction of execution time and 
computation expense. 


3-23 Establishing the Necessary Size 
of the Iteration Interval 


It is difficult to predict in advance the size of the iteration interval that will 
be required to achieve a given degree of accuracy in a simulation problem. 
In theory, the necessary size of the interval could be determined for linear 
problems by an analysis in the z-transform domain; in practice such a pro- 
cedure would be exceedingly cumbersome for all except the most trivially 
simple problems. In practice, trial-and-error methods are necessary. These 
preferably are conducted during short but typical runs, 

With some of the standardized module techniques, such as IBM 
360 CSMP, optional means are often provided for having the interval Ar 
adjusted automatically, iteration by iteration, so that given accuracy require- 
ments will be met. This is often done by employing two different integration 
techniques that will tend to produce complementary errors and then using 
the difference between the results produced as a measure of the computation 
error; the interval is reduced (but always to some integer submultiple of 
the printout interval) until the error specification is met. 

One practical method for selecting At to meet given error specifications 
is based upon the assumption that the error caused by the use of finite inter- 
vals will converge to zero as the interval itself is reduced to zero, It should 
be noted, however, that the error itself cannot be measured directly because 
of a lack of knowledge of what the correct results should be (Only in the 
most trivially simple simulation problems is a computation of the correct 
results practical.) 

It first is necessary to establish the criterion by which error is to be 
described. One of the most convenient, and also most realistic, is the rms 
error. If the value of the variable of interest, say y, is designated as y, when 
it is computed at the ith iterative interval, as contrasted with the correct 
value y,,, the error at the /th iteration is then 


o 
6 
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C= Yu— Nt (3-56) 


The rms error, for a total of n iterations over the trial run, would then be 


rms = (3-57) 
Such an rms-error criterion places particularly heavy penalties on large 
transient errors, 

It is not possible to employ relation (3-56) and (3-57) directly because 
of the lack of knowledge of what the correct value y, is. It is, however, 
possible to complete the test simulation run more than once, first with 
At = t, and then with At = ¢,, The computed values of the variables of 
interest resulting from each of these computations are designated as y, and 
J}, respectively. If At, and Ar, are related in such a way that some of the 
iteration intervals occur at the same value of #, the values of y, and y, may 
then be compared. 

For example, if Ar, = 4Ar,, then y, and y, may be compared during 
every Af, iteration (every other At, iteration), The differences between the 
computed values for each ith Ar, iteration are then observed; i.e., 


Ay; = V1, — Vx (3-58) 
Then the rms value of y, is computed; i.e., 


/u (Ay,)? 
AY:ms = 


- (3-59) 


The basic assumption is then made that 
tim < AYrms (3-60) 


where e,,,, is the rms error that would result if the larger interval, Ar,. 
were employed. 

The above assumption can be established by a statistical analysis that 
will not be described here, This analysis is, in turn, however, dependent 
on a number of additional assumptions concerning the absence of cross- 
correlation between the computation errors caused by successive trial runs. 
The best justification for the assumption stated by relation (3-60) is that it 
has applied for all test cases when it was tried (test cases where it was possible 
to determine y, exactly). 

If the specified rms error is designated as e,,, the required condition 
that 


Crms < esp (3-61) 
will be met provided that 
Yams SCs (3-62) 
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and the larger iteration interval that was employed, At,, can be used in the 
simulation runs with the accuracy requirements being met. 

The size of the iteration interval At is also restricted in the sense that 
it must be equal to At,,/k, where At, is the required printout interval at which 
results will be recorded or stored and k is any integer. The most effective 
procedure for establishing the minimum permissible value of k that will meet 
the error criterion of relation (3-60) consists of trying, progressively, values 
of k equal to 1, 2, 4, 8, etc. (ie., values of k equal to 2”, where n is the number 
of trial-simulation runs made after the first, where At was set equal to A?,,). 
If the criterion should be met on the nth trial, it will then be known that 
the minimum permissible value of the divisor k will lie between 2"-* and 
2"-!, The range of integers lying between these values might be subdivided 
into, say, 10 equal parts to establish the next range of trial values. 

Suppose, for example, that 10 trials were made following the first 
(where k = 1) before the error criterion is met. The last value of k employed 
would then be 2° or 1024 (i.e., At was At,,/1024). The minimum permissible 
value of k lies between 2° and 2°, or between 256 and 512. This range would 
then be divided into roughly 10 equal parts of integer size (i.e., Ak is 256/10 
rounded off, or Ak = 26). Hence the effects of values of k equal to 282, 
308, 334, 360, etc., would be investigated. 

Suppose, in the above example, that it is found that the error criterion 
is met again when y, is based on At = At,,/334 and y, on At = At,,/360. 
The value of k equal to 334 would then be considered adequate and Ar 
would be so selected, as At,,/334. The minimum permissible value of k 
could be determined still more closely to exactly the lowest permissible 
integer, but normally there would be little point in continuing the search 
that far. 

In some instances it fortunately may be found that the error criterion 
of relation (3-62) is met the first time it is tested (when k = 1). Under these 
circumstances, At would be set equal to the printout interval Ar,,. 


Suggested Problems 


3-1. A system to be simulated is described in block-diagram form in Figure 
P3-1. Draw block diagrams expressed in terms of the g operator to show 
the computation processes that would take place when each of the methods 
listed in Section 3-3 is employed in the simulation process. 


FIGURE P3-1 
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3-2. Assume that method la-1 is to be employed for simulating the system 
described by Problem 3-1. w is constant and nonzero; y initially is zero. 
Use the z transform to obtain an expression for y(n) and then for y(t) (valid, 
of course, only when ¢ = n At) that would result with this method for any 
given choice of iteration interval At. Compare this with the correct result, 
yt), and comment on the relationship of the computation error to the size 
of the interval Ar. 


3-3. It has already been stated that method la-2 will result in an unstable 

computation response when applied to many simulation problems involving 

feedback. Show that this will be the case when this method is applied to 

Problem 3-1, using either the g operator or the z transform. 

3-4, Repeat Problem 3-3, this time with integration method 1b-2. 

3-5. Repeat Problem 3-2, this time with integration method 2a-1. 

3-6. 

(a) The system represented in Figure P3-6a is a positional-control system. 
It is to be simulated by digital means. Prepare a program for this purpose 
which can employ any of the following numerical methods of integration 


by calling the appropriate subroutine: (1) method la-1, (2) method 
1b-1, (3) method 2a-1, (4) method 4a-1. 


error sensor and 
electronic controller controlled process 


reference 
input, 
deg 


FIGURE P3-6a 


(b) The reference input in this problem, r, is assumed to follow the time 
relationship illustrated in Figure P3-6b. The response is of interest for 


t, sec 
1.0 


FIGURE P3-6b 
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t= 1 to t= 20sec. Assume initial conditions of rest. A printout of 
response is desired every second. 

Execute the program of part (a) on this basis. (This assumes that sub- 
programs for the various methods of numerical integration have been pre- 
pared.) First use method 4a-1 with At = 0.01 sec. The results thus obtained 
may be considered as substantially correct and can be used as the basis of 
comparison (as y,) with the runs to follow. Then determine for each of the 
methods of integration proposed the required At and execution time to 
achieve an accuracy of roughly 1 per cent in the determination of c. (1 per 
cent accuracy means 1 per cent of the 100 deg change, or +1.0 deg.) 


3-7. Repeat Problem 3-6, now using the simple lag module, item 1 of Table 
3-5, to represent the transfer function 


20 
1+ 01s 


Compare the required At and execution time with those observed in Problem 
3-6. 

3-8. Design a single module (i.e., add to Table 3-5) that could represent 
the combination of the first two transfer blocks in the block diagram of 
Problem 3-6, i.e., 


200(1 + s) 
(I+ 0.1s\(l -F 10s) 


3-9. Repeat Problem 3-6, now using the module just designed in the preced- 
ing problem. 


3-10. As a later study concerning the system of Problem 3-6, the limiting 
of the signal designated as m to some maximum value will have to be con- 
sidered. This can be represented in the block diagram by inserting Figure 
P3-10 in the signal path involving m. We are not being asked to simulate 
this now. However, with this future problem kept in mind, what restrictions 
are placed on the module approaches suggested in Problems 3-7 and 3-9? 


limiter as before 
lh igs 101 +s) a 
Vv Vv 1+ 10s deg/sec 
FIGURE P3-10 


References 


1. W. E. Milne, Numerical Solution of Differential Equations (New York: John 
Wiley & Sons, Inc., 1953). 


Chap. 3 References 141 


2. R. W. Hamming, Numerical Methods for Scientists and Engineers (New York: 
McGraw-Hill, Inc., 1966). 


3. H. R. Martens, A Comparative Study of Digital Integration Methods Simula- 
tion, Vol. VII (Feb, 1969), 87-96. 


4. M. L. James, G. M. Smith, J. C. Wolford, Applied Numerical Methods for 
Digital Computation with Fortran (Scranton, Penn.: International Textbook Co., 
1967). 


5. J. R. Ragazzini and L. A. Zadeh, The Analysis of Sampled-Data Systems 
Transactions of the AIEE, Vol. LXXI, Part II (Applications and Industry), 
(1952), 225-232. 


refroner fern 


Appendix 3A: 
Introduction to the z Transform 


When dealing with continuous linear functions of time, it is frequently 
convenient to work in terms of the Laplace transform of the time function 
rather than with an operational form based on the operator, p = d/dt. F(s) 
will be described as the Laplace transform of the function f(t) (i.e., F(s) = 
&[ f(t] when 


F(s) = fs fide" dt (3A-1) 


with appropriate restrictions placed on f(t) and the range of s to guarantee 
convergence of this complex integral). 

It then is found that when a differential equation in ¢ is expressed in 
terms of its Laplace transform, the variable s appears in the transformed 
equation in the same manner as the operator p would have appeared with 
the operational approach, except that additional terms also appear to account, 
automatically, for the initial condition. For example, consider the differen- 
tial equation 

2. 
a at +6 a +cy=0 with y(0) and »(0) given 
The operational version of this equation is 
(ap? + bp + c)y = 0 
Solutions for y = y(t) based on the operational approach yield terms with 
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unknown coefficients; it is necessary to insert these initial conditions into 
the problem to solve for these coefficients. On the other hand, the Laplace 
transform of the equation is 
(as? + bs + c)¥(s) = (as + b)y(0) + ay(0) 
The effects of the initial conditions are now included. The characteristic 
equation is, however, the same with either method and is 
(ap? + bp +c) =0 or (as? + bs +c) =0 
In either event, the roots (poles of the y response function) are the same. 
When a continuous function f(t) is changed to a discrete form, where 
it is evaluated at only discrete sampling instants spaced by a constant interval 
At, it will be described as f*(t). It has significance only when ¢ = n At, 
where n is an integer (i.e., only values of f(n) = f(n At) are known). This 
sampled version of f(t), or f*(t) is considered most conveniently as a train 
of impulses (Dirac functions). That is, 
S¥*(t) = MO) + (SE — Ad) + f(t — 2 Ad) + ++ 
+ f(n)d(t — n At) Soft ss 
or x f - 
S*O) ZO = 0 Ad (3A-2) 
n=0 
The Laplace transform of f*(r) then is 
Fs) = £f*(0) = & Y fms — n Ar) 
n=0 


= Yseioe — nA) 
or 
F¥3) = 3 flmens (3A-3) 


The variable s appears in such a transform only within the exponent (—n Ats). 
It, therefore, is convenient to make the substitution 


z= et (3A-4) 


and F*(s) now becomes a new function of z, called simply F(z), and equal 
to 


FQ) = 3 fz" (GA-5) 


This is called the z transform of f(n). In reiteration, it is simply the Laplace 
transform of the sampled version of f(t) [i.e., f*(t), with the substitution 
made that is expressed in relation (3A-4)]. 

Construction of a table of z transforms is often quite simple. Suppose, 
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for example, that f(t) = K = constant. Then 


Fe= Yker=K(1 +4454 454--)= KAW GAH 


The conversion to a closed form is not always as simple as in the above 
example. Another very useful case is when /(n) = Ke". Then, from relation 
(3a-5), 


F(z) = 3 Kez" ky or 


«lg t wep wT sa 


or 


F(z) = K— (3A-7) 


Ze 


It should be noted that when /(”) = Ke, as in the above example, then, 
since n = t/At, 


FO x Kes" = Ke" where b = a/At (3A-8) 


A table of transforms may be built up in this manner. Transforms of sinusoidal 
functions can be established from relation (3A-7) with a becoming imaginary. 
Such a resulting tabl¢s|of transforms is shown as Table 3A-1. More complete 
tables are available in textbooks that treat this subject in more detail, but 
the list given here should be adequate for the types of problems that are 
discussed in this chapter. 

Just as with the Laplace transform, there is a corresponding inversion 
relationship for the z transform that permits the obtaining of f(m) directly 
from F(z). However, as with the Laplace transform, this relationship involves 
integration in the complex plane. Hence this procedure generally is avoided; 
instead, implicit methods are used based on partial fraction expansions. Use 
may then be made of the transform table, particularly transform pairs 
(1), (2), (5), (6), and (7). 

When direct use of the table is not possible, to obtain the inverse 
transform of more complicated expressions involving the ratio of polyno- 
mials of z, use may be made of partial fraction expansions, just as is done 
to find inverse Laplace transforms. As an example of this, let it be supposed 
that transform pair (10) of Table 3A-1 was not furnished, and it was desired 
to find the inverse transform of 


°)=G—fiea® 
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TABLE 3A-1_ Table of z Transforms 


S(n) tS) F(z) 

(1) 1 or u(n) lor u(t) 

(2) ean eet, where b = a a 

(3) cos Bn cos wt, where @ = ee ee 

(4) sin Bn sin wt, where @ = £ = ta 

(5) n or nu(n) ct or ctu(t), where c = 4 @ £ 1D 

(6) n2 or n2u(n) ct? or ct2u(t), where c = can on 

(7) nean cteet, where c = ron b= a fe <a 

(8) ea sin Bn e% cos wt, where b = i o= £ Zz ene aa 

(9) e9" cos Bn e sin wt, where b = u ,O= £ ° a ee oe i 
reas Gren Where bi = ft, ba = 2 CaaESe 


The partial fraction expansion of this expression would be 


EQ) ae 


ey on 


If k, and k, are evaluated, use can then be made of transform pair (2) of the 
table to find the inverse transform f(n). The coefficients of the partial fraction 
expansion, k, and k,, may be found in a manner somewhat similar to that _ 
used for Laplace transforms: 


BES [: Siro] = F = al. = = ry 


k,= [ = fra] - [ +5]. = 7 


From transform pair (2), the term z/(z — f) corresponds to the transform 
z/(z — e*), if e* is considered equivalent to f. Hence, for this term alone, 
J(n) would be k, f”. Similarly, for the second term in the expression for F(z), 
f(n) would be k, g". If the values of the coefficients k, and k,, as just deter- 
mined, are then substituted, the complete inverse transform is 


_ ft—s 
VOD re 


Naturally, since transform pair (10) was available in the table, this inverse 


moron 


Fat 
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transform could have been evaluated without such a partial fraction expan- 
sion. 

The significance of the pole locations of a z transform is also of interest. 
This has already been discussed to some extent in Section 3-12. The general 
considerations concerning this may be summarized by comparing the corre- 
sponding s and z planes with the connecting relation (3A-4) kept in mind. 

Complex pole locations in the s plane are described most conveniently 
in terms of the undamped natural frequency w, and damping ratio ¢. The 
conjugate pair of poles will then be located at 


s= —lo, + jo,/1 — @ (3A-9) 


This is shown in Figure 3A-la, From relation (3A-4), the corresponding 
z-plane locations of these poles are 


z= ett 
= exp (—Ca, At) exp (+jo, At /1 — @) (3A-10) 
In other words, these poles will be located at a radius from the origin 


|z| = exp (—Ca, At) (3A-11) 
and will be on the unit circle for zero damping, within it for positive damping, 
and outside it for negative damping (a divergent process). The poles will lie 
on radial lines forming the angles +-v with the positive real axis, where 


v=o, At /1—@ (3A-12) 
This is shown in Figure 3A-1b. The discussion of Section 3-12 illustrates 
how this interpretation may be used to determine the frequency of any 
oscillatory computation response that might result and the extent to which 
it is damped (is convergent). 


s plane z plane 


unit 
circle 


poles 
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for case 
where 

$>0 


(a) (b) 


FIGURE 3A-1a FIGURE 3A-1b 
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To apply the z transform to the difference equations that describe 
the effects of iterative computation procedures, use is made of the shifting 
theorem. If Z is used to represent the process of z transformation, [i.e., if 
Z[f(n)] = F(z), then 


Z[f(n + 1)] = 2F(2) — 2f() (3A-13) 
and 

Z[f( + 2)] = F(z) — 2f) — 2f(1) (3A-14) 
etc. The above relations were presented as relations (3-27). Their proof is 
fairly simple. Restating relation (3A-5), 


F() = 3 fede 
If a new integer variable, kK = n — 1, is now substituted, this becomes 
Fe) = 3 fe + Deer 
Sic Dees ey fk + Iz* 
= (0) + 2°" 3 fle + e* 
Multiplying all terms by z and rearranging yield the result 
Uk + Dr* =2F@) — FO 


The symbol n may now be substituted for k in the above without changing 
the validity of that statement. Then 


dye + Iz" = zF(z) — 2f(0) 
However, from (3A-4), 
Zif(a+ 1] = Lia +1)z" 


If the above relation and that preceding are combined, relation (3A-9) is 
proved. Relation (3A-10) may also be proved by an extension of the above 
procedure. 
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Nonlinear Operations 
with Analog Computers 


4-1 General Comments 


The analog-computer elements that have been described thus far included 
summer, integrator, and inverter types of amplifiers, potentiometers, and 
various forms of auxiliary output equipment. As a result, the situations that 
could be simulated with that equipment have been limited to those describ- 
able by linear differential equations (i.e., those where analytic solutions are 
always possible). The range of application of analog-computer simulation 
is enhanced greatly by the addition of elements that allow various types 
of nonlinear operations to be performed. The most basic of these elements 
will be described in this chapter. 


4-2 Diodes 


In an analog computer-program diagram, the conventional circuit symbol 
shown in Figure 4-1 is used to represent a diode element. An ideal diode 
is one that possesses zero resistance to current flowing from the anode to 
the cathode and infinite resistance to inverse current flowing in the opposite 


direction. Therefore, it would have a volt-ampere characteristic that appears 
as shown in Figure 4-2. Actual diodes used in analog computers normally 
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a represents anode 
ac c represents cathode 


LS FIGURE 4-1 


FIGURE 4-2 


are of the high-vacuum (becoming obsolete) or the semiconductor type. 
(Zener diodes represent a special case to be considered separately.) They 
are never ideal but approach being so as their quality (and cost) increases. 
Their volt-ampere characteristics might appear as shown in Figure 4-3. 
Actual diodes, therefore, do at least tend to favor strongly the flow of cur- 
rent in one direction and to oppose it in the other. 


Vae 


jac 


exaggerated version for 
a very poor diode 


FIGURE 4-3 


Separate individual diodes are often available in analog computers, 
either built in with the terminals brought out for connection as desired to 
other elements, or as loose elements attached to leads for direct insertion into 
the patchboard. Such individual diodes are used to construct a number of 
special-purpose circuits and to simulate various nonlinear situations. These 
applications include the generation of various nonlinear continuous func- 
tions, to be discussed in this chapter, and also the simulation of various 
discontinuous effects, to be discussed in Chapter 6. 

Circuits that employ diodes to produce nonlinear but continuous func- 
tions of one variable are called diode function generators. These may be 
subdivided into three categories: 
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1, Special function-generator circuits patched up by the person estab- 
lishing the program. 

2. Special-purpose function generators used to develop some specific 
commonly used functions. These are prefabricated. 

3, Adjustable general-purpose diode function generators, also prefab- 
ricated. 


4-3 Diode Limitations—The Ideal Diode Circuit 


Figure 4-3 showed (in exaggerated form) the volt-ampere characteristics 
of an actual, and hence imperfect, diode. These imperfections are caused by 
the fact that even a high-quality diode is not a perfect conductor in its forward 
direction nor a perfect nonconductor in its backward or inverse direction. 

These imperfections may be reduced markedly by the ideal diode 
circuit shown in Figure 4-4. The circuit employs two actual diodes in con- 


equivalent ideal 
ez to a1 £2 


FIGURE 4-4 


nection with the components of a normal inverter circuit. When input 
voltage e, is negative, diode 1 conducts, resulting in such effective negative 
feedback about the operational amplifier that negligible output voltage e, 
results. Diode 2, therefore, is cut off and e, is zero. As a result of this rein- 
forcing action of the two diodes employed in the circuit, a very sharp cutoff 
characteristic is achieved whenever e, is negative. 

On the other hand, whenever e, is positive, diode | is cut off and 2 
conducts, resulting in e, being an almost perfect version of —e,. The result 
is a characteristic that approaches much more closely the ideal character- 
istics shown in Figure 4-2. The term ideal diode circuit is, of course, somewhat 
of a misnomer; the diode performance resulting is not completely ideal, 
but it is far closer to being ideal than would be possible with a single diode 
alone, even one of high quality. This convenient and useful technique pre- 
sents one example of why the astute analog programmer should have some 
rudimentary knowledge of the electronic principles involved. Occasions 
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may well arise when such a circuit is necessary but, in many modern com- 
puters, will not be available in an already packaged form. It must be arranged 
by the programmer. 


4-4 Example of a Simple Diode Function 
Generator—Absolute-Value Circuits 


The simplest nonlinear function to be generated is the absolute-value function 
y =|x|; the simplicity of the arrangement generally used for accomplishing 
this is such that the circuit scarcely rates the complexity implied in the term 
diode function generator. Such a circuit is shown in Figure 4-5; its method 
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FIGURE 4-5 


of operation is self-explanatory. The lower plot of y versus x illustrates the 
effect of the diode’s deviation from being truly ideal. Such absolute-value 
circuits are generally constructed directly on the patchboard. 

The imperfections shown in the y versus x plot of Figure 4-5 can be 
reduced significantly by substituting an ideal diode circuit for the simple 
diode circuit shown in that diagram. After some modifications to reduce 
the number of elements required, this circuit appears as in Figure 4-6. In the 
circuit of Figure 4-6, when x < 0, the ideal diode circuit is cut off and the 
only signal transmitted is through the upper input connection to the summer; 


gre 


FIGURE 4-6 
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the summer then serves as a simple inverter and » = —x, or |x|. When 
x > 0, the ideal diode conducts, applying —x to the summer with a gain 
of two. Hence the output is —x — 2(—x) = x =|x|. In any event, the 
output always is |x| and an absolute-value circuit has been implemented 
that is capable of more precise operation than is the simpler circuit of Figure 
4-5, 


4-5 Generation of Continuous Functions 


The preceding example represented a function that was in itself continuous, 
but which was discontinuous in its slope. (Functions that are in themselves 
discontinuous, involving abrupt jumps in value, are developed by methods 
discussed in Chapter 6.) Even analytic functions (i.e., those involving no 
discontinuities in the function itself or in its derivatives) are developed by 
techniques generally similar to that shown in Figure 4-5 (i.e., the function 
is divided into approximate straight-line segments). The intersection points 
at the junctions of these segments are referred to as breakpoints. The func- 
tion is then represented in a piecewise linear fashion. In other words, the 
analog procedure used is equivalent to the digital procedure of table “look- 
up” with subsequent linear interpolation. 

Figure 4-7 shows an example of a crude straight-line approximation 
of the cosine relationship over the range of x from —z to +z radians. In 
terms of machine variables, the following scale factors are employed as an 
example (applicable to 100 V machines): 


y=0.0ly, and x=0,0lzx,, 
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FIGURE 4-7 
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Hence the relationship becomes y,, = 100 cos (zx,,/100). A tabulation is 
prepared corresponding to the breakpoints in Figure 4-7, which is shown 
here as Table 4-1. (It should be realized that Figure 4-7 is not intended to 
represent a good approximation; in practice more segments would be 
required. The example is simply for the purpose of illustrating the principle 
of the diode function generator.) 

In Table 4-1 it may be noted that first the range of positive x,, is covered, 


TABLE 4-1 
Breakpoints Correct Adjusted! Aym ,(A¥m 
Xm Ym Ym Axm AYm ae a(x) Comment 
0 100.0 100.0 —0.608 100 V parallax 
12.5 —7.6 —0.608 Constant 
negative slope 
12.5 92.4 92.4 —1.128 Fourth quadrant 
12.5 —21.7 —1,736 
25.0 70.7 70.7 —0.856 Fourth quadrant 
12'5 3214 =2.592: 
37.5 38.3 38,3 —0.472 Fourth quadrant 
25.0 —76.6 —3.064 
62.5 —38.3 38.3 0.472 First quadrant 
12,5 —32.4 —2.592 
75.0 —70.7 —70.7 0.856 First quadrant 
12:5: =21:7, —1.736 
87.5 —92.4 —92.4 1.128 First quadrant 
12.5 —7.6 —0,608 
100.0 —100.0 —100.0 
—0.608 
0 100.0 100.0 1,212 Third quadrant 
—12.5 —7.6 0.608 
=12;5 92.4 92.4 1.128 Third quadrant 
—12.5 —21.7 1.736 
—25.0 70.7 70.7 0.856 Third quadrant 
—12.5 —32.4 2,592 
—37.5 38.3 38.3 0.472 Third quadrant 
—25.0 —76.6 3.064 
—62.5 —38.3 —38.3 —0.472 Second quadrant 
—12.5 —32.4 2.592 
—75.0 —70.7 10.7 —0.856 Second quadrant 
—12.5 —21.7 1.736 
—87.5 —92.4 —92.4 —1.128 Second quadrant 
—12.5 —7.6 0.608 
—100.0 —100.0 —100.0 


1Jn this example the correct values of the function and the adjusted values at the 
breakpoints happen to be the same; hence the two columns are alike. In general, better 
curve fitting results when this is not the case. 
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starting from x,, = 0. The results from this part of the table indicate that the 
following procedure should be employed. The steps described are illustrated 
in Figure 4-8. 


(a) 


A constant output voltage corresponding to the value of 
Vn at X,, = 0 should be established. This is 100 V and is 
called the parallax. 

A constant slope of —0.608 is then to be added (i.e., 
Vn = —0,608x,,). 


— 


parallax constant slope 
step (a) step (b) 
12.5 
62.5 
fourth-quadrant break first-quadrant break 
[steps (d) and (¢) are similar] [steps (g) and (h) are similar] 
step (c) step (f) 


y —62,5 


third-quadrant break second-quadrant break 
[steps (j), (k), and (1) are similar] [steps (n) and (0) are similar] 
step (i) step (m) 


FIGURE 4-8 
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(c) A slope of —1.128 is to be added, starting at the x,, = 
12.5 V breakpoint. The diagram for step (c) shows why 
this is described as a fourth-quadrant break. 

(d), (e) Slopes of —0.856 and —0.472 are to be introduced at 
X,, = 25.0 and 37.5 V breakpoints, respectively. These also 
are fourth-quadrant breaks. 

(f) A slope of 0.472 is to be introduced at x,, = 62.5 V. This 
is called a first-quadrant break. 

(g), (h) Slopes of 0.856 and 1.128 are to be introduced at x,, = 
75 and 87.5 V. These also are first-quadrant breaks. 


The table is then completed as shown. For the negative range of x 
the following procedure results: 


(i) A slope of 1.212 is introduced at x,, = 0. This is a third- 
quadrant break. 

(j), (kK), (I) Slopes of 1.128, 0.856, 0.472 are introduced at x,, = 
—12.5, —25.0, and —37.5 V. These also are third-quad- 
rant breaks. 

(m), (n), (0) Slopes of —0.472, —0.856, and —1.128 are to be intro- 
duced at x,, = —62.5, —75.0, and —87.5 V, respectively. 
These are described as second-quadrant breaks. 


Figure 4-9 shows one method of generating this function. This method 
is based upon floating bias supplies, chosen not because it is the most prac- 
tical, but because it is easy to understand. (Confusion should not be caused 
by the use of the circle symbol for both potentiometers and floating power 
supplies; the latter are distinguished by the plus and minus signs.) 

In most practice other schemes, avoiding the use of such floating 
supplies, are employed. For example, the arrangement used to obtain the 
first-quadrant break in the Figure 4-9 circuit appears as shown in Figure 
4-10; it is called a series type of diode function generator, for obvious reasons. 

Alternative series-diode methods, which avoid the use of floating power 
supplies but perform the same function, are shown in Figure 4-11. 

Still another type of function generator, known as the shunt-diode type, 
may be used to establish any of the four quadrant type of breakpoints. 
Additional shunt elements may be added to create additional breakpoints 
in any quadrant. This is shown in Figure 4-12. 

Still other methods consist of using diodes in conjunction with the 
feedback elements of a summing amplifier. Here, again, the diodes may 
be used in the shunt or series sense. 

In general, there are a large variety of diode function-generator cir- 
cuits that may be invented to solve specific problems. Usually such circuits 
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are planned by the person doing the programming when only a few break- 
points are needed. For a situation involving many breakpoints, it is far 
easier to use a prefabricated function generator. These are either special- 
purpose units to produce specific commonly required functions as shown 
in Figure 4-13, or general-purpose units where the adjustments must be 
established manually in order to meet a given relationship. 


yx? y=x|x| y=vx y= Il 
nO: |x| 
y =exp (-x) y= logy x y=cosx y=sinx 
x20 x>0 
FIGURE 4-13 


4-6 Scaling of Function Generators 


When generating a desired functional relationship, the same general con- 
siderations regarding scaling apply as were considered in Chapter 2. Several 
examples are given here, as they would be applied to a 10 V computer (V, 
= 10V). 


EXAMPLE 1 y,, = kx2, with x,, having a voltage range of 4-V,: 


1 


lYmul=kKV RSV, of ks p= 


With & then selected as 0.1, the relationship used is 
Vm = 0.1x32, 
EXAMPLE 2 y,, = k,/x,, with x,, having a voltage range 0 < x,, < V,: 
ge ny ee Shay el or Kir V2 S316, 


Selecting the next lowest round factor, k = 2.50 and 


Vu 2 50/ m 
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EXAMPLE 3 » = cos x with x ranging from —z to +2 radians. As the 
maximum magnitude of y will be unity, logical scaling for y is 


Ym =Vy=Wy V 


Scaling for x depends upon whether the angle x is being expressed in radians 
or degrees. 


(a) x expressed in radians: if x,,= kx, then as | Xmax| = 7 
[Steccon) =e or k< "= 318 
Selecting k as the next lower round quantity, or k = 2.5, the 
relation is 


Vm = 10 cos (2.5x) with x being in radians 


(b) x expressed in degrees: now, a8 | Xmax | = 180, | Xm. | = 180k < V,, 
or k < V,/180 = 0.056. Selecting k as the next lower round 
quantity, or k = 0,05, the relationship used then is 


Vm = 10 cos (0.05x) with x being in degrees 


(This relationship, corresponding to 20 degrees per volt, is common 
with resolvers used in 10 V computers.) 


In general, it may be seen that the scaling problem will depend very 
much upon the intended application of the function generator. For this 
reason, there are a limited number of specific functions for which it is prac- 
tical to provide special purpose fixed function generators. Often it is more 
convenient to employ an adjustable general purpose unit instead of one that 
is scaled to meet the specific requirements of the problem being simulated. 


4-7 General Purpose Function 
Generators—Adjustment Procedures 


Most modern general purpose computers will be equipped with a sufficient 
number of general purpose function generators, so that the programmer 
need never be concerned with constructing arrangements of the type shown 
in Figures 4-9 to 4-12. He need, instead, merely prepare a listing of slopes 
and breakpoints, as in Table 4-1, and proceed from there in adjusting a 
commercial form of general purpose function generator in accordance with 
the instructions furnished by the manufacturer of that particular unit. Such 
function generators are designed on the basis of the principles described in 
Section 4-5. However, an understanding of their principles isn’t necessary 
for their successful use. Nevertheless, such principles will be important 
later, when the subject of simulating discontinuous functions is discussed 
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in Chapter 6. Hence they were described here. These principles will also 
be of interest to those concerned with the design of special purpose analog 
simulators for “permanent” programs, where the use of general purpose 
units would be unnecessary and wasteful. 

Manual adjustment of even the most modern general purpose function 
generator is a somewhat tedious process, particularly if a high degree of 
precision is required. More elaborate hybrid installations can avoid this 
tedium by providing means by which breakpoints and slopes are established 
automatically from instructions fed to the digital portion of the computer. 
This may even be combined with a program that establishes optimum slopes 
and breakpoint locations on the basis of some curve fitting technique, such 
as that involving the least-mean-square error. 

When such elaborate hybrid facilities are not available and manual 
adjustment of function generators is necessary, a rapid and convenient 
method exists that is adequate when the accuracy requirements are moderate, 
(In many simulation problems, the function to be simulated is not known 
more closely than, say, +5%.) This method is illustrated in Figure 4-14 
and involves the use of a cathode-ray oscilloscope. The independent variable 
x is produced by a sweep circuit [i.e., merely an integrator developing the 
relation x = kt that is operated in the high-speed-repetitive (HRO) mode]. 
This sweep voltage is applied to both the horizontal plates of the oscilloscope 
and also to the input terminals of the function generator, where it serves 
as the test input voltage. The output of the function generator is connected 
to the vertical plates so that the function being produced may be observed 


cathode- 
ray 
oscilloscope 


integrator in HRO 
(high-speed-repe- 
titive) mode 


FIGURE 4-14 
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during the course of its adjustment. This function, so plotted on the oscil- 
loscope screen, is matched against either a template or a pattern drawn on 
the screen representing the actual function desired. In this manner, adjust- 
ment of the function generator’s breakpoints and slopes is greatly facilitated. 
The accuracy of such a procedure depends to a large extent on the size of 
the oscilloscope screen; one about 20 in. in diameter is most desirable. 

The theory of function generators employing diodes is based upon 
straight-line segments and hence upon linear interpolation. This introduces 
sharp discontinuities in the functions generated that could, in some instances, 
cause various extraneous effects in the simulated response of the system being 
studied. The very imperfections, however, of the actual diodes used prevent 
such sharp discontinuities from occurring and introduce some curvature 
at each breakpoint. In other words, the diode imperfections actually con- 
stitute an advantage in this respect. 

In instances when the curvature thus afforded by diode imperfections 
is not adequate, additional curvature may be introduced by adding a very 
high frequency (well beyond the frequency range of interest of the problem 
being simulated and beyond the frequency range of the output equipment) 
sinusoidal voltage to the voltage that establishes the segment’s breakpoints. 
This signal is generally introduced into the circuit by means of a transformer 
and may be used to introduce considerable curvature at the breakpoint 
when this is desired. 


4-8 Other Types of Function Generators 


Other methods of function generation are also employed, although the 
diode method has proved to be the most successful and popular. To intro- 
duce sharp discontinuities, or sudden jumps, electromechanical relays 
(comparators) or their more rapid electronic equivalents are employed. 
Such comparators will be described in the section to follow; their special 
application to the generation of discontinuous functions will be discussed 
in Chapter 6. 

Still another method that might be mentioned for reasons of primarily 
historical interest involves the use of tapped potentiometers. Here, servo- 
mechanisms of the type used with electromechanical multipliers are required 
to position a linear potentiometer to a setting that corresponds to the 
abscissa value of the function being generated. In addition to the normal 
movable tap available on an ordinary potentiometer, there are a number 
of equally spaced fixed taps. These correspond to the breakpoints of the 
function generator (hence the breakpoints cannot be selected at will). Each 
of these fixed taps is supplied an adjustable voltage by its own individual 
potentiometer; this voltage corresponds to the ordinate value desired at each 


Sec. 4-8 Other Types of Function Generators 163 


breakpoint. As with diode function generators, a linear interpolation effect 
occurs within breakpoints. Although this method sounds straightforward 
and convenient, it is subject to the following disadvantages: 


1. The breakpoints are established in the construction and cannot be 
changed to suit the function being simulated, as they can with 
diode units. 

2. There is a maximum slope limitation because of the limits imposed 
on the voltage difference permitted between any two adjacent taps. 

3. It has the disadvantage of all servomechanism-driven elements in 
its relatively slow response to changing values of the abscissa. 


Another method of function generation involves the use of an XY 
plotter, employed in other than its usual sense as an output element. Many 
such units have a curve-following attachment for this purpose. The pen is 
replaced by a sensing unit, either a pickup coil or a photoelectric scanner. 
The curve representing the function to be generated may be drawn in various 
ways, depending on the sensing mechanism used. In some instances a con- 
ducting wire or ferromagnetic wire is mounted on the paper following a 
curve corresponding to the function’s relationship; in others the curve is 
painted on with a conducting paint; in still others, employing photocell 
scanning methods, a simple India-ink curve is drawn. In all instances the 
independent variable is used to position the X axis, and the Y position, 
established by the servomechanism following the curve, is also indicated 
electrically, this indication serving as the function generator’s output. This 
method of function generation shares with the tapped-potentiometer method 
the response-speed limitations inherent in all servomechanism-driven devices; 
as a matter of fact, the servomechanisms used with XY plotters generally 
tend to be slower (because of the larger masses to be positioned) than those 
used to position potentiometers. 

Still another method of function generation that is especially con- 
venient when the accuracy requirements are moderate (within 2 per cent) 
are photoformers. This is the cathode-ray oscilloscope counterpart of the 
XY-plotter function-generation technique described above; its application 
is shown in Figure 4-15. The functional relationship desired is plotted and 
used as the basis of an opaque mask placed against the screen of a conven- 
tional cathode-ray oscilloscope, All areas of the oscilloscope screen above 
the curve are kept clear while all below are masked. The oscilloscope screen 
is then covered by a light-tight shield containing a photocell. The photocell 
output is then connected, as shown in Figure 4-15, through an amplifier to 
the vertical input terminals of the oscilloscope. 

The small bias voltage shown is sufficient to drive the oscilloscope 
beam to the top of the screen, but, as the mask is uncovered, the photocell 
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cathode-ray oscilloscope 
with internal amplifiers 


mask covering screen 
below function curve 


photocell 


light-tight 
shield 


FIGURE 4-15 


voltage will tend to drive the beam downward, below the mask. The result 
is that the beam tends to ride the edge of the mask and follow the curve as 
the oscilloscope is scanned horizontally by the x,, input voltage. Therefore, 
the voltage that is applied to the vertical input terminals of the oscilloscope 
is an indication of y,,. 

It may be seen that this method is basically similar to the use of an 
XY plotter as a function generator, just described. It does not, however, 
have the response-speed limitations of the XY plotter because of the negli- 
gible inertia of the beam and the other negligible response lags involved. 
The method is simple and, although specially made photoformers may be 
purchased, any reasonably high-quality cathode-ray oscilloscope can be 
converted to a photoformer in any well-equipped electronics laboratory by 
the addition of a few additional components. 

When hybrid (digital-analog) combinations are being employed, the 
function-generation feature may be assigned to the digital computer. This 
is especially convenient when the function can be expressed in closed algebraic 
form. When the function is an empirical one, both analog and digital pro- 
cedures depend upon a tabulation (segmentation) of the function with suit- 
able interpolation techniques added. When only a small number of segments 
are required (e.g., less than, typically, 24), the analog-diode function gen- 
erator may prove to be the most convenient method; on the other hand, for the 
equivalent of many segments, the digital computer would be preferred. 

No mention has been made here of the generation of functions of a 
random variable. This will be handled as a separate subject when the various 
problems associated with such variables and the techniques for their various 
statistical measurements are discussed. 

The discussion of function generators, to this point, has been confined 
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to functions of only one variable. Analog methods for generating functions 
of two variables have been developed, but none of these can claim to be 
simple. XY plotters have been used for this purpose to produce z(x, y), 
where z is represented by the height of the surface (generally made of plaster 
of paris or a similar material) representing the function. Obviously, some 
sensing method for determining this height is required. Mechanical three- 
dimensional cams have been used for establishing functions that are not 
subject to adjustment changes; as a matter of fact, this technique was used 
in antiaircraft gun directors during World War II long before electronic 
analog computers were in general use. Similar to the X Y-plotter method, 
the photoformer can be used by employing a variable density mask so that 
the transmission of the beam, measured in terms of its intensity at the pho- 
tocell, is an indication of z(x, y). In general, the problem can be simplified 
if a suitable valid approximation can be made so that 


2, =z,(x) 

Z, = 2,(y) (4-1) 

z=k,z, +k,z, + 32,2, 
The last term in the third relation represents the multiplication of machine 
variables, a process to be discussed later. With such a multiplier, summers, 
and a combination of ordinary function generators (handling functions of 


only one variable), a number of functions of two variables can be satisfac- 
torily simulated. 


4-9 Comparators 


A comparator is a device that may be used for various logical operations; 
its operation is based upon the algebraic sum of two applied voltages. The 
simplest (but not necessarily the most satisfactory) type of comparator 
consists of a conventional electromagnetic relay actuated by summing 
amplifiers. This is illustrated in Figure 4-16. Because of the diode shown 


NC (normally closed) contact 


ARM 
4 NO (normally open) contact 
zy | 
relay 
Be coil 


FIGURE 4-16 
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there, the relay coil is acutated only when (EZ, +- £,) > 0. If one of these 
signals, E, or E,, had previously been inverted, a comparison would have 
been made, establishing which of the signals was algebraically the greater, 
hence the term comparator. Figure 4-16 represents a single-pole relay com- 
parator. In practice a number of poles could be employed, all actuated by 
the same relay coil. 

More modern equipment is apt to employ semiconductor comparators 
that involve no moving parts and hence are capable of much faster opera- 
tion. The conventional signal for the comparator is shown in Figure 4-17. 


at when (E, +E) <0 

“ U=0 

when (E, +£,)>0 

E, U=1 
FIGURE 4-17 


Here the output U is a logical variable, either one or zero (true or false). 
U may possess a number of physical forms; for example, it may be some 
positive voltage for U = | and some negative voltage for U = 0. In Figure 
4-16, U would have represented actuation of the relay coil. (U = 1 means 
the coil is actuated and normally open contacts are closed.) The comparator 
is not necessarily connected to a relay or switch. Its binary output might 
instead be fed to various binary logic circuits. When it is so connected to a 
relay, the combination is variously referred to as a relay comparator or a 
comparator switch. The general diagram for such a combination is shown 
in Figure 4-18. The arrangement shown schematically in Figure 4-18 performs 
the same function as that of Figure 4-16, except that it switches two channels, 
labeled a and b, and hence is a two-pole relay comparator. 

The numerical designation (13 in the example) is used when a number 
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FIGURE 4-18 
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of such relay comparators are employed in a program and must be separately 
identified. The subscripts shown are necessary when the comparator and the 
relay contacts do not appear adjacent in the diagram of the program. The 
first subscript will be an a, c, or 0, referring respectively to the arm, nor- 
mally closed, and normally open terminal of the switch. The second sub- 
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FIGURE 4-19 
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script is used only with a multipole relay and identifies the switching channel 
involved. This subscript designation is somewhat arbitrary but it has been 
proposed as the standard convention. 

Such comparators have many applications. As mentioned before, 
they can replace diodes (although there rarely is a reason for so employing 
them since a diode is generally more convenient). Figure 4-19 shows how 
this might be done. 

As an example of logical operations performed with comparators, 
Figure 4-20 shows the arrangement for simple AND and OR circuits. Here 
the logical variable is represented by a positive voltage when true and by 
a negative voltage when false. The second arrangement is based on De- 
Morgan’s law, whereby x 4 y= ¥ Uj. With many analog computers, 
logical AND and OR circuits may be furnished directly rather than having to 
be patched from comparator relays, inverters, and diodes. For relatively 
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complicated logical arrangements, a knowledge of switching theory employ- 
ing Boolean algebra is a definite aid to program planning. 


4-10 Multivibrator Circuit Employing Comparators 


In some applications to follow it will be necessary to develop a periodic 
wave to serve as a synchronizing clock for various discrete operations. 
Provisions for this are sometimes included in the computer, certainly in all 
hybrid computers. However, such a clock circuit is easy to synthesize from 
standard analog elements. Two useful types of such waves are of the square- 
wave form and the triangular-wave form. From these forms other forms 
may be obtained by shaping circuits. A variety of circuits exists for such 
multivibrators. Some of these depend upon feedback circuits involving dis- 
continuous functions, as discussed in Chapter 6, One simple multivibrator 
circuit that uses only the simplest analog-computer components plus one 
comparator is shown in Figure 4-21. 
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4-11. Comparator Control of Integration Time 


One very useful application of a comparator is in stopping the program or 
part of a program (throwing one or more integrators into hold) when a 
specified terminal result has been achieved. Suppose, for example, that the 
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simulation program develops a variable of interest, y(r), in response to dis- 
turbances, x(t), and the item of interest is specifically y(t,). By stopping 
the simulation at what corresponds to problem time ¢,, (t,) may be easily 
and accurately read by a digital voltmeter. The general procedure for handling 
such operation is shown in Figure 4-22. 
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FIGURE 4-22 


In Figure 4-22 it should be noted that it is necessary to employ a timing 
integrator to develop a machine indication ,, of the problem time ¢. This 
voltage, representing elapsed time, is compared with one representing 1, 
(i.e., the voltage f,,,). Therefore, when the problem time reaches the assigned 
value ¢,, the comparator causes all integrators of the program (including 
the timing integrator) to be thrown from the operate to the hold mode. 
Figure 4-22 is a logical diagram of this operation. It means that when J 
(not U) is true, the integrators are in the operate mode; when U is true, in 
the hold mode. The actual mechanization of this operation depends upon 
the computer equipment that is available. One method consists of using the 
comparator in connection with a relay that will open the summing junction 
whenever the comparator becomes actuated (U is true). 
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It need not be elapsed time that causes a program to terminate by 
throwing the computer (or portions of it) in the hold mode. This termination 
decision may be affected by any problem variable. 


EXAMPLE Let the traditional trajectory problem be considered, as illus- 
trated in Figure 4-23. The details of the actual simulation program need 


xy 
FIGURE 4-23 


not be discussed here. It will suffice to say that the program will develop 
machine indications of the horizontal and vertical coordinates, x and y, 
and of their time derivatives, x and ). 

Let it be considered that the question of interest relates to the hori- 
zontal range x, attained when the missile reaches some vertical coordinate 
y, on the way downward. This may be determined by stopping the program 
when the event {(y <y,) 0 (} <0)}={ >9,) UG > 0)} occurs. The 
program for accomplishing this is shown in Figure 4-24. 


4-12 Track-and-Hold Circuits 


There are a number of applications when an amplifier is to follow or track 
various program variables during what is called the tracking period but is 
to hold them at their last tracked value during other intervals, known as 
the holding period. There are a variety of circuits employing comparators 
for accomplishing this; one example employing a relay comparator is shown 
in Figure 4-25. 

With this circuit, when the comparator is not actuated (FE, + E, <0 
and U = 0), the operational amplifier serves as a simple inverter and y,, = 
—x,,. The capacitor C connected to the output (through a small resistance 
R, used to limit the flow through the relay contacts) has its other end 
grounded and hence is charged to y,, volts. (The time delay associated with 
this charging should be negligible if the total charging resistance, i.e., the 
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source resistance presented by the amplifier’s output plus R,, is not too 
large.) 

When the comparator is actuated (E, 4+- E, > 0 and U = 1), the sum- 
ming junction is disconnected from the grid and, simultaneously, the 
formerly grounded end of the capacitor C is connected to the grid. The 
amplifier then acts as would an integrator when in the hold mode; the value 
of y,, is maintained constant (i.e,, stored) at the value that it had at the instant 
of comparator actuation. 

It should also be noted that by using more than one input resistor, 
inputs may be added and their sum then tracked; hence the simplified sym- 
bolism shown in Figure 4-25 may show more than one input signal applied. 
Furthermore, the input and feedback resistors need not be of the same value, 
so multiplication by a gain factor is also possible. This more general case 
is shown by the symbolism of Figure 4-26. In the simplified symbolism sug- 
gested here, the sequence of the letters TH has significance. They mean that 
the amplifier normally tracks (when the comparator is not actuated); when the 
comparator is actuated, holding takes place. It should also be noted that the 
same comparator may be used to control more than one track—hold amplifier. 

The particular implementation of Figure 4-25 represents but one 
technique. One other very common method is based on the principle that 
if a signal is applied to the initial condition terminal of an ordinary integrator, 
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|) FIGURE 4-26 


the integrator will act as a simple inverter, possessing, however, some re- 
sponse lag because of the RC time lag associated with the initial condition 
circuit (see Figure 2-24). Integrators, so utilized, become tracking amplifiers 
when in the IC mode and hold, of course, when switched to the hold mode. 
Integrators intended for this type of track-hold operation (they also may be 
used as integrators in the ordinary sense) are designed with the initial- 
condition charging-time constant short enough that the tracking lag will be 
negligible in consideration of the dynamics of the problem being simulated. 

What has been proposed as the official symbolism for a track—hold 
amplifier, rather than those shown in Figures 4-25 and 4-26, is based upon 
this particular implementation. This symbolism is shown in Figure 4-27; 


FIGURE 4-27 


it is simply that of an ordinary integrator, given, however, a vertical orien- 
tation, Inputs are shown as applied to the IC rather than normal input 
terminals. Mode-control inputs are shown as arrows; these might be O 
(operate), H (hold), IC (initial condition), and/or T (track), depending upon 
the particular equipment. The association of these mode control signals with 
the actual operating function of the amplifier is then shown by a truth table. 
This suggested symbolism is not employed in this book because this manner 
of showing mode controls is somewhat awkward and, although unambigu- 
ous, is hard to follow. Furthermore, this symbolism is somewhat “equip- 
ment peculiar” in that it refers to one specific method for implementing 
track—-hold operation—that of applying the signal to be tracked to the initial- 
condition terminals of an integrator. 

One example of the use of a track—hold circuit is the storage of machine 
variables of interest as they are developed at specific instants of problem time. 
With such circuits this storage may be accomplished without interrupting 
the continued simulation of the problem for future time. Suppose, for 
example, that y(r) is being generated by some program and the values of y 
at time instants f,,f,,...are to be stored. Figure 4-28 shows an arrange- 
ment for accomplishing this. 
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The function of the track-hold circuit may always be reversed (i.e., it may 
be converted to a hold-track circuit by reversing the controlling function of 
the associated comparator). When relay comparators are used, this would 
mean simply interchanging the connections to normally open and normally 
closed relay contacts. This complementary arrangement of a hold-track 
circuit is represented symbolically in Figure 4-29. Now the amplifier will 
hold when E, + E, <0, and track when E, + E, > 0. 


Ey 
FIGURE 4-29 £2 


The cascade combination of track-hold circuit and a hold-track circuit 
is an especially useful combination, known as a ratchet circuit, or memory 
pair. The symbolic diagram to be used here for such a circuit is shown in 
Figure 4-30. By means of a ratchet circuit, discrete sampling of continuous 
functions becomes possible. For example, if the comparator is actuated by 


--——> j to additional 
} comparators for 
—— 
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a periodic wave, the input to the circuit will be “sampled-and-held” every 
time the periodic voltage applied to the comparator becomes positive. 
The result will be as shown in Figure 4-31. This ability to sample continuous 
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FIGURE 4-31 


data (specifically, in this example, in a manner known as sampling with 
zero-order hold) is particularly useful in the simulation of digitally controlled 
systems, where precisely such a sampling effect does take place. 

Another use of the ratchet circuit is as a pulse counter. This circuit, 
employing positive feedback around the ratchet circuit, is shown in Figure 


ps 
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4-32. The circuit of Figure 4-32 is an example of the employment of a hold— 


Vy (0) 


pulse signal 
being counted 


FIGURE 4-32 


track amplifier also used in a summing capacity. It should also be noted 
that if a time-varying voltage x(t) should be substituted for the constant 
bias voltage AV and if the pulse signal should be periodic, this circuit would 

——sinrulate the process of numerical integration by the rectangular method, 
method-ia-1 (see Chapter 3). 

The most useful applications of ratchet circuits are for the purpose 
of dynamic storage. For such applications it is necessary to operate the 
ratchet circuit and other associated portions of the program in a high- 
speed-repetitive mode. Ordinary electromechanical-relay comparators are 
usually not fast enough for this purpose and normally high-speed-electronic 


(solid-state) comparator units are employed. 


4-14 Dynamic Storage 


In brief, dynamic storage [1, 2] of a problem variable does not mean that 
it is stored in the sense used with digital computation, such as core storage, 
but rather that it is computed repeatedly and its value stored by means 
of a holding capacitor between cycles of the computation. This implies, 
correctly, that the computation should be conducted in a high-speed-repeti- 
tive mode. Normally, when dynamic-storage techniques are employed, some 
of the computer's integrators will be operating in the normal time mode 
and others in this high-speed (HRO) mode. This will require localized mode 
controls so that only selected integrators will have such HRO operation. 
In the program diagrams to be used here, those integrators that are to be 
operated in the HRO mode will be identified as shown in Figure 4-33. One 
of the applications of dynamic storage is in function generation. Dynamic- 
storage techniques permit any function that can be generated as a function of 
machine time to be generated as a function of any other machine variable. 
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HRO FIGURE 4-33 


EXAMPLE 1 Let the function y,, = 0.1x2, require generation over the range 
of x,, from 0 to 10 V. This function could be produced by a diode function 
generator. Still another convenient way is the dynamic-storage method to 
be described now. This method is possible because the relation 


2, = te 
is the solution of the differential equation 
oie =2k with z,(0) =0 and 2,(0) =0 


The computer program for this is shown in Figure 4-34. So far, the program 
shown in Figure 4-34 simply generates a voltage following a parabolic time 


—2k 
‘: K ‘™ 
2k =kr2 
ni > > am = kt 


FIGURE 4-34 


relationship that eventually would exceed the voltage range of the computer 
and cause an overload if the computation were not interrupted. However, 
this function is to be generated in the HRO mode and & will be such that 
Z, never exceeds the rated voltage range of the computer before computa- 
tion is interrupted and reset for another cycle. Suppose that the period of 
computation is to be 20 msec and the computer has a nominal range of 10 V. 
The desired value of k would then be 10/(0.020)? = 25,000, so this 10 V 
limit will be reached in 0.020 sec. If integrator gains of 100 are employed 
(k, = k, = 100), the required voltage to be applied to the first integrator 
will be (2)(25,000)/(100)(100) = 5 V. The Figure 4-34 program then appears 
as shown in Figure 4-35. What is desired is the value of y,, = 0.1x2; this is 
identical to z,, when 


0.1.3, = 25,00023, 


or when 500f,, = X,. 


lov be 2m = 25,00082, 


HRO 


FIGURE 4-35 
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It therefore is necessary to generate, as well, the voltage corresponding 


to 500/,,. This is done by means of a third integrator, also operated in the 
HRO mode, as shown in Figure 4-36. 
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If a ratchet circuit is added so that the result of the z,, computation 
is sampled at every iteration of the instant when 500r,, = x,, the result 
will be the correct computation of y,, as it applies at that time. The computer 
program for this is shown in Figure 4-37. 

The asterisk attached to the output y,, should be noted. This is to serve 
as a reminder that y,, is sampled every repetition period (in this example, 
about every 25 msec) and that a continuous computation of y,, is not being 
obtained. However, if the sampling frequency is beyond the significant fre- 
quency range of the system being studied, no significant sampling error 
would result. (Here the sampling frequency is about 40 Hz, considering the 
20 msec computation time per repetition and estimating about 5 msec for 
the reset time; this method, therefore, would be adequate with this repetition 
rate if the system being simulated had no significant response, in terms of 
machine time, at that frequency.) For some applications a higher rate of 
HRO repetition would be required than in the example here. 

In the particular example shown, it happens that one less integrator 
could be used since the required timing signal, 5007,,, happens to be produced, 
in the inverted sense, in the function generation itself. This modified circuit 
would appear as in Figure 4-38. 

In the circuit of Figure 4-38, as the two signals are applied to the 
comparator in the sense opposite to that of Figure 4-37, it is necessary to 
reverse the ratchet circuit by making the first amplifier a hold-track unit 
and the second a track-hold unit. 


EXAMPLE 2 This example is the same as | except that x,, now varies between 
—10 and +10. Ordinarily, this would require a major modification of 
the program (as the next example will show) as f,, necessarily starts at zero. 
However, in this instance advantage may be taken of the fact that the func- 
tion to be generated, y,, = 0.1x2, is an even function of x,. An absolute- 
value circuit (Figure 4-19b) can be used and the signal —x,, applied to the 
comparator instead. 


EXAMPLE 3 Here y,, = exp (0.2x,,), where —10 < x,, < 10 V. 
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FIGURE 4-38 


The function z,, = k, exp (k,t,,) can easily be generated as it is the solu- 
tion of the differential equation 


="=k,z, with z,,(0) = k, 


Let it again be supposed that the computation time per repetition is selected 
as 0.020 sec. Then t,, = 0 should represent the lower end of the range of 
Xm) OF X,, = —10 V, and t,, = 0.020, the upper end, or at x,, = 10 V; i.e., 


0.020 
"=O (10) % 


Equating the y,, and z,, relationships, 
exp (0.2x,,) = k, exp (10-7k,x,, + 0.01k,) 
= k, exp (0.01k,) exp (1072k,x,,) for all x,, 


t 


10) = 1.0 x 10-*x,, + 0.010 


or 
0.2 
10-3 


0.2x, =10-k,x, and k, = 4, = 200 


and 
1 =k, exp (0.01k,) = k, exp (2) = 7.39k, and k, = 0.1354 
The function z,, to be generated is, therefore, 
Z, = 0.1354 exp (200/,,) 


It is to be sampled by the ratchet circuit when ,, — 0.01 = 107*x,,, or when 
1000¢,, — 10 = x,,. 
The program for accomplishing this is shown in Figure 4-39, 


4-15 Multiplication by Dynamic Storage 
(Time- Division Multiplier) 
Up to now one of the basic arithmetic operations, multiplication, has been 


neglected in the discussion of analog computers because it is, admittedly, 
a more difficult operation using analog methods than digital. However, 
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FIGURE 4-39 


dynamic-storage techniques do permit this operation to be accomplished 
in a reasonably simple fashion. 
(a) Two-quadrant multiplication: 


Zn = aa 
where 
OS Kees Ve Vr ee 


Here one of the factors, x,,, is always positive and values of x,,, ¥,, and z,, 
can be accommodated within the voltage range, V,, of the computer. A 
general program for accomplishing this type of multiplication is shown in 
Figure 4-40a; a specific program for the special case when V, = 10 V and 
the computation interval in the HRO mode, f,, is 20 msec is shown in Figure 
4-40b. 

The operation of this method is explained most easily in terms of 
Figure 4-40b. The upper integrator in that diagram produces, in reality, 


the final integral 50 is Vm dt, but, if the computation interval ¢, is sufficiently 
short so that y,, essentially is constant during the interval, this is a valid 
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(a) general program 


ratchet circuit 


(b) program for computation period, ¢, = 0.020 sec, V, = 10 V 
FIGURE 4-40 


approximation of the quantity SOy,,t,,. In the meantime, the lower timing 
integrator is producing a sawtooth wave of voltage indicative of the quantity 
5007,,. When this voltage becomes equal to the voltage —x,,, the ratchet 
circuit will sample and hold the output of the upper integrator. That is, 
when 500f,, =X, OF t,, = X,/500, the voltage —SOy,,t,, will be sampled 
and held until the next repetition of the HRO mode. But this voltage is 
—50y,,(%,,/500) = —x,,¥,/10, the desired product (when inverted). Hence 
multiplication has been accomplished. 

(b) Four-quadrant multiplication: 


where 
= SX Ye Ses a esalor 


When both factors may appear in both the positive and negative ranges 
of voltage, the multiplication program must be modified to accomplish this. 
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FIGURE 4-41 


Figure 4-41 shows one type of program used to handle such a four-quadrant 
problem for the specific case where r, = 0.020 sec and V, = 10 V. 

Other multiplication arrangements employing dynamic storage are 
also possible. As a matter of fact, this general principle of multiplication 
was known long before dynamic-storage techniques, in general, were devel- 
oped. Units employing this method frequently are described as time-division 
multipliers. They are furnished as self-contained units by a number of manu- 
facturers and employ a variety of electronic circuits; these may be used with 
computers that do not, in other respects, have dynamic-storage capability. 
However, when dynamic-storage capability is present, such multipliers can 
always be fabricated directly on the patchboard. 

Static accuracy depends upon accuracy of switching but, in well- 
designed units, 0.1 per cent is obtainable. Dynamic accuracy depends on the 
ratio of the repetition rate to the significant response frequencies of the sys- 
tem being simulated and can always be improved by increasing the frequency 
of repetition. (Higher repetition frequencies may, on the other hand, aggra- 
vate the problem of accurate switching.) 


4-16 Quarter-Square Multipliers 


Another popular method of analog multiplication, which does not involve 
switching schemes as does dynamic storage, is the quarter-square method. 
This method employs only conventional amplifiers plus diodes. 
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Quarter-square multiplication is based upon the following algebraic 
identity: 
ye te Emi) (4-2) 
q 
From this relationship, it is obvious that what is required in addition to 
conventional summers are two square-law diode function generators. As 
mentioned previously, these are often available as prefabricated units. The 
program utilizing relation (4-2) for four-quadrant multiplication would then 
appear as in Figure 4-42. Naturally, there are many variations of this pro- 
gram but the basic principles remain the same. 
Such quarter-square multipliers are generally prefabricated units, 
sometimes complete in themselves and sometimes of the type that must 


FIGURE 4-42 


borrow operational amplifiers or inverters from the computer in which it is 
installed. (These are borrowed on the patchboard; the amplifiers are then 
available for other purposes when the multiplier is not in use.) However, 
the multiplication program may be fabricated directly on the patchboard. 

Usually, because of the limitations on the accuracy of the square-law 
function generators, the sfatic accuracy of these multipliers is not as good 
as with the time-division type mentioned previously. Typical would be 
0.1 per cent meaning 0.1 per cent of the maximum voltage range V,. For 
a 10 V computer this would mean that the product would be obtained 
correctly within 0.01 V. But, for example, if x,, = 1.0 V and y,, = 1.0 V, 
the correct product would be x,,)’,,/10, or 0.1 V and a 0.01 V error would 
mean an actual error of 10 per cent. Somewhat better static accuracy is 
possible with a well-designed time-division multiplier. On the other hand, 
the time-division type has the upper-frequency limitations mentioned pre- 


XmYm 
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viously because of its sampling nature. The upper-frequency limitations of 
the quarter-square type of multiplier are, on the other hand, usually the 
frequency-response limitations of the operational amplifiers involved. Hence 
the dynamic accuracy of the quarter-square type might well be superior. 
Which of these two types of multipliers should be employed depends on the 
problem to be simulated and on the time scaling chosen. 


4-17 Other Types of Multipliers—General 
Program Diagram for a Multiplier 


Other methods of multiplication have been, and sometimes still are, used 
with analog computers. Because they are encountered much less often than 
are either the quarter-square or the time-division methods, detailed discus- 
sions of them have been postponed until Appendices 4A to 4C. Among 
these methods are the following: 


Logarithmic multipliers. 

. Servomultipliers. 

. Hall-effect multipliers. 

. Crossed-field multipliers. 

. Digital multiplication with hybrid computers. 


AUkWN— 


Logarithmic multipliers employ diode function generators capable of 
developing logarithmic functions; their application to multiplication is 
obvious. They possess the advantage that they can multiply when the factors 
involved appear to any power [i.e., they can perform the operation 

2m = K%m)Vn)? 
where a and b need not be integers]. On the other hand, they possess obvious 
disadvantages. When either of the factors goes “through zero,” difficulty 
is encountered because the logarithm of zero is minus infinity and the 
logarithm of a negative number is complex. This disadvantage can be over- 
come by various “trick” programs. Scaling difficulties also may occur; these 
are discussed in Appendix 4A. 

Servomultipliers are based on the mechanical setting of potentiometers 
to positions that correspond to one of the factors of the multiplication 
process. At one time such multipliers represented the type most often found 
in analog installations. Such multipliers are capable of satisfactory static 
accuracy, but, because of the response-speed limitations of mechanical 
positioning devices (servos), their dynamic accuracy is severely limited. 
There are also obvious adjustment and maintenance problems associated 
with such electromechanical equipment. Nevertheless, servomultipliers still 
exist in a number of analog installations. They are particularly convenient 
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when a number of products must be obtained that are all associated with 
one common factor. 

Hall-effect and crossed-field multipliers are ingeneous schemes pro- 
posed during the earlier development of the analog-computer art. They are 
rarely if ever employed in modern equipment but are mentioned in Appendix 
4C because of their historical interest. Digital multiplication is an obvious 
method with hybrid computers but is practical only in such installations 
where the necessary interface equipment is available. 

The proposed standard symbol, to be applied to all multipliers regard- 
less of the method employed, is shown in Figure 4-43. With this symbol, 
a + or — sign should be affixed to the symbol signifying the output to 
indicate whether or not inversion takes place. The divisor a usually, but 
not always, will be the reference voltage V,. 


= +t xy/a 
FIGURE 4-43 y 


4-18 Resolvers 


The name resolver is given to analog-computer elements that perform the 
operations 

x=rcos@ 
and/or 

y=rsin@ 
Usually a given resolver can perform both of these functions simultaneously, 
and there are frequent occasions when it is called on to do so. 

These resolver operations, called rectangular resolution because they 
transform polar to rectangular coordinates, are really a combination 
sine and cosine function generation with multiplication. Indeed, one metl| 
for accomplishing such resolution is by means of ordinary diode function 
generators, adjusted to develop the sine and cosine relationships, in associ- 
ation with two multipliers. Ordinarily, however, in commercially furnished 
resolvers the operations of function generation and multiplication are handled 
together so that the programmer need not be concerned with these separate 
operations. The program diagram to be employed here to represent a resolver 
(polar to rectangular resolution) is shown in Figure 4-44. 

At the start of the development of analog computers, resolvers were 
exclusively electromechanical. They were called servo resolvers, employing 
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positioning servomechanisms, just as do servo multipliers. These are used 
to position nonlinear potentiometers specially wound so that the poten- 
tiometer’s transfer factor f will be a sinusoidal (or cosinusoidal) function 
of its angular rotation. Such servo resolvers possess the same advantages 
and disadvantages as servo multipliers. Nevertheless, they are still used in 
many existing computer installations, As more details concerning their 
operation may be of interest to some readers, they are described more com- 
pletely in Appendix 4D. 

The modern trend has been toward purely electronic (solid-state) 
resolvers possessing no moving parts. These again are combinations of diode 
function generators and multipliers. Various arrangements are provided by 
component manufacturers. In some instances, both +x and + are available 
at the output terminals; in others, any required inversion of the output 
must be external. 

Scale factors associated with a resolver are established by the manu- 
facturer. For a 10 V computer typical scale factors might be such that 

Xm = Im COS (208,,)° 

Vm = Pm Sin (206,,)° 
In other words, in this example one degree of angle is represented by 0.05 V. 
A total angular range of +-200°, therefore, could be accommodated by the 
voltage range of the computer. Other scale factors are also provided to 
accommodate larger or smaller angular ranges. Resolvers are also available 
with the angular scale factor based on radians rather than degrees. 

The inverse operation of polar resolution (i.e., of converting rectangular 
to polar coordinates) may also be handled by resolvers. Then the operation 
that effectively is performed is 


6=tan 2 
x 


Usually these mathematical operations are not performed directly. Instead 
implicit methods are used, to be described in Chapter 5S. 

The program diagram to be used to represent a resolver performing 
polar resolution is shown in Figure 4-45, 


4-19 Summary 


The basic tools that enable analog computers to handle nonlinear as well 
as linear operations are 


1. Diodes—the essential element of function generators and of many 
of the techniques for simulating discontinuous operations that are 
treated later in Chapter 6. 
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2, Function generators. 

3. Comparators—sometimes playing a role similar to diodes but also 
making possible such important operations as dynamic storage; 
they also may be used to perform logical operations and to change 
the program configuration. 

4, Track-and-hold circuits—essential for use with dynamic storage 
methods; they will prove to be very important with hybrid installa- 
tions. 

5, Multipliers—a number of schemes have been used but time division 
(based on dynamic storage) and quarter-square remain the most 
successful and convenient methods. 

6. Resolvers—for both polar to rectangular and rectangular to polar 
conversion. 


Not all the tools have been described in this chapter. Others are avail- 
able that depend upon implicit procedures, the subject of Chapter 5. 


Suggested Problems 


4-1. Design a function generator to develop the nonlinear function shown 
in Figure P4-1 that uses 


FIGURE P4-1 


(a) An open computer with floating power supplies. 

(b) A closed computer with diodes and both conventional grounded 
and floating potentiometers. No floating power supplies nor resis- 
tive or capacitive elements are to be used except for those directly 
associated with amplifiers. 

(c) Aclosed computer, as in (b), but with comparators instead of diodes. 


4-2. The following differential equation is to be represented: 


dy) PIN Aah 
Bhs + f(y, 1) =0 
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where 


L(y, 1) =fi(y) when f(y) > fA and f,(y) > 0 
=f, when f,(y) < f(t) and f,() > 0 
=0 when f(y) < 0 and f,(1) < 0 


Assume that the functions /,; and f, have already been defined and set up 
on diode function generators. Prepare a program (without regard to scaling) 
to handle the above problem 
(a) Using diodes, but no comparators. 
(b) Using comparators, but no diodes (except those internal to the 
function generators establishing f, and /,). 


4-3. Assuming a computer of voltage rating V,, select the best scaling 
factor, k, to be used when the following functions are generated; then 
express K in a practical form for 100 and 10 V computers. 


@). y, = Kinx,, 0.0001V, < x,, < V, 
(b) ¥, = K exp (ax,,) 0<x,<V¥, 
© ys = Ke Oars 
(d) 2,, = KxXn¥an ese ean 6 Oe ie 

a>1 
(©) Ym = Km? 0<x,<V, 
@) 2, = K/xt +32 Vee xen —V,< Vn < V, 
(8) Pm = K4m| 4m =, ga 


4-4, When a linkage drives a second element having friction but negligible 
inertia through a coupling having backlash (free play), the relation between 
the input displacement x and the output displacement y is as shown in 
Figure P4-4. Develop a program using comparators for generating the 
functional relationship between x and y. Do not consider scaling. 


bf 
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FIGURE P4-4 
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4-5. In Problem 1-1 when applying different trial interest rates, the only 
quantity of interest is that principal that applies at the end of 10 years. 
Arrange to stop the analog computation when that period of time has been 
reached. 


4-6. A proprietary device called a NO-BACK is sometimes used to couple 
a driving source and load. The mechanical design of this device is too com- 
plicated to describe here, but its action may be described approximately as 
follows: Q, is the input torque and Q, the output torque; q@ is the velocity. 
1, When | Q,| >|Q,| and m = 0, a braking torque, Q,, is established 
by the device that will be just sufficient to prevent rotation. 
2. When |Q,|<|Q,| or a #0, this braking torque is removed. 
In this problem the driving source is a motor that will develop the torque 
Q, under steady-state conditions: 


OQ, = 4V — 20M kg-cm 


where V is the applied armature voltage, ranging from —100 to +100 V, and 
@ is in rad/sec. The motor and no-back input have a combined inertia of 
5 kg-cm/(rad/sec?). The no-back output and load have a combined inertia 
of the same amount. The load also consists of a variable torque Q, that 
can range between —SO and +50 kg-cm. 

Consider that the no-back has negligible friction (other than braking 
torque Q,). Prepare an analog program that will show the response of the 
velocity @ to varying values of V and Q,. 


4-7. This relates to the example of Figure 4-23. Assume that the projectile 
(having no self-propulsive means) has an initial angle 0, adjustable from 
0 to 30° and that it has an initial velocity of 300 yards/sec. All forces acting 
on it other than gravity are being neglected. The shape of the terrain is given 
by the following table: 


x, yards y, yards 
0 0 
500 50 
1000 160 
1500 360 
1680 400 (peak) 
2000 270 
2500 250 
3000 360 
3350 500 (peak) 
3500 480 
4000 440 
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Prepare a program that will simulate this situation and will plot, automati- 
cally, the range x at which contact with the ground occurs, versus the angle 0,. 
4-8. This is an extension of Problem 4-5. Modify the analog program to 
simulate the quarterly compounding of interest. 

4-9. A continuous variable x(t), ranging from —100 to +100 V, is to be 
quantized to the nearest volt. Develop an analog-computer program for 
accomplishing this. 

4-10. Figure 4-40 shows a two-quadrant multiplier and Figure 4-41 a 
modification for the handling of four quadrants. Develop a different modi- 
fication of Figure 4-40b, employing diodes and/or comparators, for handling 
four-quadrant multiplication. 

4-11. Simulate the situation described by the following differential equation: 


ay AY yom ay 
at tap ke =0 wherea>0 
Assume that dynamic-storage facilities are available. 


4-12. Prepare a program for evaluating the double integral: 


Teal f bow fir) ar] dx 


where f,(r) ranges from —10 to +10 V, f(x) ranges from zero to +10 V, 
x ranges from zero to +10 V, and w ranges from zero to +10 V, f(x) and 
f(r) are particular functions already established on diode function gener- 
ators. Use dynamic storage to develop the program. 


4-13. Given independent variables x and y, produce the function 
PAT Gent where 0.1 <x < 10 V,0.1<y<10V 


The only function generators assumed to be available are fixed-diode func- 
tion generators capable of the operations uv = 10 log,,v or v = (10)#'°. 
Assume that multipliers are not available. Prepare a program, taking scaling 
into account. (A suitable value of K must be chosen.) 


4-14, What time function is generated by the program found in Figure 
P4-142 


—-10V 


Re ie 


<i: ? 
e2/10 


FIGURE P4-14 
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4-15, The assembly in Figure P4-15, which consists of a triangular plate 
supported by three vertically aligned springs connected to a horizontal 
supporting member, is completely submerged in sea water. The support is 
subjected to vertical motion only and the three points of support of the 
plate may also move only vertically. The support displacement from some 
designated neutral position is described as x ft. The plate displacement, 
measured from the normal steady-state position when x = 0, is described 
as y ft, with y,, y,, and y, being the specific values of y at the three spring 
contact points. 


plate: d= 10 ft 
a 1=10ft 
weight, mg = 500 Ib 
springs: 
3 ky =k, = 1500 lb/ft 
k; = 2000 lb/ft 
(neglect spring mass) 


nN 


hydraulic pressure on plate 
caused by vertical velocity, 
J ft/sec, is 


KZA 


support 


FIGURE P4-15 


p= ppl yl lb/ft? 
where p is the density of sea 
water 
= 2.0 Ib-sec?/ft# 
(edge effects neglected) 


Prepare a program to simulate the dynamics of this situation in re- 


sponse to imposed motions x. The range of x is + 
sec; and of x, +10 ft. 
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Appendix 4A: 
Logarithmic Multipliers 


As described in the main body of this chapter, logarithmic multipliers are 
particularly convenient for performing operations of the form 


2 eye when x > 0 andy >0 


Scaling requirements are specially important and not obvious on the surface. 
In terms of machine variables the relationship would be 


yb 
a xah 
c 


2m 


where ¢ is some constant that will provide proper scaling. Usually c is 
determined by z,,,,,, Which should not exceed V, when both x,, and y,, are 
equal to V,, That is, 


‘ayb 
Zz =< ie OD cs Viet’ 


‘Mma 


As a specific example, consider a 10 V computer (V, = 10) where the multi- 
plication operation is to be 


z= x+y? 


Then c > 10?-* = 250 and c is chosen as 250 since this is sufficiently round. 
The machine relation will be 


volts (4A-1) 
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Now let it be supposed that the logarithmic function generators used are 
of the type that will cover a logarithmic range of four decades, i.e., from 
0.001 to 10 V. Their relationship (with u,, and w,, being simply any general 
machine variables) will be 


Up, = Slog; (10w,,) volts (4A-2) 
The inverse, antilog function generator would be of the form 
W,, = 0.1(10)""* volts (4A-3) 


Relation (4A-1) may be converted to a form compatible with the 
logarithmic function generator [i.e., with relation (4A-2)]. Then 


(10x,,)'*(10y,,)? _ (10x,,)' *(10y,,)? 
250(10)?:* 62,500 


10x,,.= 


or 
log, (10z,,) = 1.4 log, (10x,,) + 2.0 log, (10y,,) — 4.796 
The actual computer operation, therefore, would consist first of the inter- 
mediate step involving a variable designated as w,,. 
Uy, = 510g; (10z,,) = y log, (10x,,) + 10 log,, (10y,,) 
— 2.398 volts (4A-4) 


The second step would consist simply of the antilog operation 
Bm OAL) volts (4A-5) 


The value of z,, that would result would then be in accord with relation 
(4A-1). Figure 4A-1 shows a program that might be used for accomplishing 
this. 

In this program it should be noted that care is taken that not only 
the final output z,, will not overload, but also that the intermediate amplifiers 
will not overload nor underload. This type of multiplier is limited to operation 
in the first quadrant; it is also limited to values of x,, and y,, that are not 


5 logyg (10x, ) 


antilog DFG 


FIGURE 4A-1 
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less than 0.001 V (so that the logarithmic DFG’s do not underload), These 
limits on the range of operation are shown in Figure 4A-2. 

The lower limits could have been extended by employing logarithmic 
function generators that covered a wider range of signal, more than the 
four logarithmic decades covered by the type that develops the function 
5 log,, (10w,,). However, accuracy is then impaired as the number of decades 
covered is increased. 


LD “ede 


= 2 gion operating range for 
= 1 program of Figure 4A-1 
= 05 Y) (note logarithmic scale) 
4, 
0.1 . 


0.01 O05 O02) -05 12° 5 10 


Xm Volts 


FIGURE 4A-2 


Similar scaling problems are encountered with digital computers when 
multiplying variables that are raised to noninteger powers since then, also, 
logarithmic methods are employed in the actual machine program. However, 
with digital computers the range latitude is far greater. 

In Chapter 5, implicit methods will be mentioned, including techniques 
by which the antilog function generator shown in Figure 4A-1 may be 
eliminated and replaced with a third logarithmic function generator. 

Ordinary multiplication over four quadrants can also be accomplished 
by logarithmic methods. Use is made of the relation 


Fe a | ee a , y, 
Ze q 


m Vm 


Ve |e 4 4 
The multiplication 


(4A-6) 


(2 


always involves positive factors; this multiplication may be done logarith- 
mically without any possibility of underload. To prevent overload, the final 
multiplication by 4 must be done after the other terms are subtracted. 
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Appendix 4B: 
Servo Multipliers 


The servomechanism type of multiplier was the first to be used to any extent 
with electronic analog computers. It still enjoys wide popularity, although 
this is decreasing with the modern tendency to avoid mechanical parts. It 
has the advantages of a high degree of static accuracy and the ability to 
multiply conveniently a number of variables by the same common factor. 
Its disadvantages are the additional maintenance required of electrome- 
chanical elements and its relatively slow response (and hence poor dynamic 
accuracy). 

In order to multiply one or more variables, SAY Vm, ¥mys +++ > Vm 
by a common factor x,,, and to obtain the results 


Zp, = adm, Pig me Zm, = ZnYm 


(k + 1) precision potentiometers, mechanically coupled to each other to 
maintain the same setting (ganged), are positioned accurately to a factor 
(not setting; note the distinction made in Section 2-17) corresponding 
to the common factor x,,. Normally, for x,, positive this setting would be 
simply 


p=Xn (4B-1) 
ie., an x,, of 10 V would correspond to full potentiometer rotation in a 
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10 V computer. Each of the y,, signals is applied to one of these potentio- 
meters. Since the output voltage is # times the input voltage applied to each 
potentiometer, the appropriate multiplication will take place. 

The (k + 1)th potentiometer is used as the feedback potentiometer 
and provides a signal to the servo amplifier telling it what the actual output 
setting B is so that it may be compared with the setting desired. The voltage 
V, is applied to this potentiometer; hence, if it is set correctly, the output 
voltage will agree with x,,. Any deviation between the two (as will occur 
when x,, is varying rapidly in consideration of the servomechanism response) 
will call for a correction of £ until the indicated and desired x,,’s agree. 

To explain this in terms of the servomechanism operation, relation 
(4B-1) should be rewritten as 


— Xmo 4B-2 
b=% (4B-2) 
where x,,, is the value of x,, indicated by the potentiometer’s actual setting, 


as contrasted with the x,, desired. The servomechanism operation may then 
be explained by means of the block diagram of Figure 4B-1, where x,,, 


BV, =Xmo 


stabilizing 
feedback 


(k + 1)th 
(feedback) 
potentiometer 


we 


— electrical signal transfer 


p----------4 


the 


- ignalistanste other k 
—----—---- mechanical signal transfer potentiometers 


FIGURE 4B-1 


represents the error or difference between the value of x,, called for and that 
corresponding to the potentiometer setting that has been established. Any 
such error operates to reduce itself to zero through the action of the elec- 
tronic servo amplifier and then, in turn, the servomotor that positions the 
potentiometer. As the existence of any error will result in a corrective veloc- 
ity @,, it follows that a steady-state error cannot exist whenever x,, is con- 
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stant (except for errors in the potentiometer itself and null errors in the servo 
amplifier). Under dynamic conditions (x,, varying), some error can exist, 
but this is maintained small unless the frequencies associated with the x,, 
variation exceed the frequency range of the servo system. 

There are many problems involved in obtaining a satisfactory design 
of a servomechanism for this purpose; these are handled by various special- 
ized techniques that are not within the range of subjects to be discussed 
here. It should be noted, however, that a tachometer almost always is 
employed for auxiliary feedback purposes to improve the dynamic response 
of the system. 

The arrangement of Figure 4B-1 will handle only positive values of 
X,,, With that arrangement, if x,, was to become negative, the servomechanism 
would attempt to make the potentiometer setting negative; this is not pos- 
sible and the setting would simply be zero at the extreme end of travel. In 
other words, the arrangement shown there represents a fwo-quadrant multi- 
plier. 

To handle the possibility of negative as well as positive x,,’s and hence 
achieve four-quadrant multiplication, a modification of Figure 4B-1 is nec- 
essary. All potentiometers are of the floating type and the lower end of the 
feedback, (k + 1)th, potentiometer, is not connected to the ground but to 
the negative reference voltage — V,. 

The potentiometer setting # must now be redefined in the sense that 
B =| represents the extreme top of the potentiometer; 6 = 0, the center; 
and £ = —1, the bottom. Furthermore, it will be necessary to connect the 
inverted versions of the y,, signals to the bottom of their respective poten- 
tiometers. Four-quadrant multiplication is thus achieved. 

All of the potentiometers of a multiplier are ganged mechanically; 
that is, their mechanical settings (or a's) are the same. This is no guarantee 
that their actual multiplication factors, or ’s, will also be the same unless 
all potentiometers, including the feedback potentiometer, are identically 
loaded. This is an important precaution if accurate multiplication is to be 
realized. 

There are many details to be followed and precautions to be taken 
when servo multipliers are used. These will vary with the particular units 
employed and the best instruction that can be given here is that the manu- 
facturer’s advice be followed carefully. Rules for connecting such multipliers 
on a patchboard can be slightly complicated; these will vary depending on 
the equipment employed. 

A detailed program diagram naturally should be kept as a record of 
the patchboard connections when using a servo multiplier. The nature of 
such a diagram will depend upon the particular unit employed. Such details, 
however, would complicate the overall diagram describing the entire simu- 
lation program and, therefore, in the macroscopic program diagram the 
general symbol for a multiplier shown in Figure 4-43 is recommended. 


Appendix 4C: 
Other Types of Multipliers 


Other types of analog-computer multipliers have been employed. One type 
that depends upon the multiplication of quantities describing physical 
phenomena is the Hall-effect multiplier.! This depends upon the fact that 
the Hall-effect voltage generated across a thin slab (of thickness ¢) of an 
appropriate semiconductor material is given by 
_ RyiB 

t 


v 


where R, is the Hall-effect factor, i the transverse current, and B the density 
of the magnetic flux component that is mutually transverse to both the v 
and i vectors. Obviously, if i is made proportional to one of the factors and 
B to the other, an analog multiplication will take place. 

Another type is the crossed-fields type, proposed first by MacNee.? 
It makes use of the fact that the force deflecting an electron beam is given by 


f=ev x B) 


where e is the charge on the electron and v and B are, respectively, the beam- 
velocity and magnetic-flux-density vectors. 


iL. Lofgren, Analog Multiplier Based on the Hall Effect, Journal of Applied Physics, 
Vol. XXIX (1958), 158-66. 

2A. B. MacNee, An Electronic Differential Analyzer, Proceedings of the IRE (Nov. 
1949), 1315-1324. 
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Both of the above types of multipliers introduce design problems, 
so accuracies better than | per cent are difficult to realize. Neither have 
any inherent limits in regard to frequency response, but, in practice, 
limitations are imposed by the design of the coil that establishes the mag- 
netic flux B. 


ralurome from p!88 


Appendix 4D: 
Servo Resolvers 


Servo resolvers are basically similar to servo multipliers and, as a matter 
of fact, combined units (i.e., multiplier—resolvers) are quite common. Figure 
4B-1 still applies in the general sense. A required angular setting of the 
potentiometers corresponding to the argument, @, is established. This would 
correspond to the angle described as £ in Figure 4B-1, except that it is 
expressed directly in terms of angle while 8 usually is described in terms of 
the fraction of the potentiometer’s travel. A linear (conventional) feedback 
potentiometer is employed to indicate this angle, just as is done in Figure 
4B-1; this indication is fed back to the servo amplifier. The feedback poten- 
tiometer must be of the floating type and have its ends connected to +V, 
if both positive and negative angles are to be accommodated. 

The other resolving potentiometers are of a nonlinear type requiring 
the voltages --r,, to be connected to their end terminals if they are to generate 
the products r,, cos @ and r,, sin @. These potentiometers normally have two 
outputs, one for the sine and one for the cosine. 

As with multipliers (and possibly more so), there are a number of 
precautions to be taken with servo resolvers if correct resolution is to take 
place. Rules regarding potentiometer loading particularly must be followed 
carefully. Again, because of the variety of designs, these precautions are 
described best by the manufacturer of the particular units used. 
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Implicit Methods 5 
of Function Generation 


5-1 Introduction 


Analog-computer methods for generating various commonly used functions 
by means of function generators of various types were described in Chapter 
4. There will be a number of instances when these techniques will not be 
necessary and when it will be possible to generate the desired function by 
implicit methods. These methods will often be convenient for digital as well 
as analog-computer simulation in instances where they can prevent difficulties 
caused by redundant operation or can be used to shorten the execution time. 


5-2 Methods Based on the Time Derivative 
of the Independent Variable 


When a function y = f(x) is to be produced and the time derivative dx/dt 
is available, implicit methods can often be used. By taking the time derivative 
of both sides of this relation, the result is obtained: 


dy _ p,\dx 
ad SO (5-1) 


If f(x) can be expressed as a function of x and f(x) that can be represented 
by the computer, i.e., if 
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Sf’) = glx SO) (5-2) 
then the operation to be performed is as shown in Figure 5-1. 


EXAMPLE The function y = e** is to be generated. Taking the time deriva- 
tive of both sides yields 


dy ax dX 
7 eee) 
initial 
dx/dt f{x(0)] 


y= f(x) 


glx, f(x)] 
computation 


FIGURE 5-1 


[i-e., £0) = e* and f’(x) = ae™]; hence f’(x) = af(x) = g[f(x)]. In this 
instance the general feedback function g[x, f(x)] happens to be independent 
of x itself and may be obtained simply by multiplying f(x) by the constant 
a. The resulting block diagram is an shown in Figure 5-2. The analog- 
computer program might appear as in Figure 5-3. 

A slightly more complex version of this method might be employ- 
ed to generate the trigonometric functions, as shown in the following 
example. 


initial condition 
2x0) 


yen 


FIGURE 5-2 
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yre™ 


FIGURE 5-3 


EXAMPLE The function y = cos ax is to be generated. Defining z = sin ax, 
it can then be established that 


dy . dx dx 
Ch asin ax7 az 
and 
Zz ite -o' (1S 
Ge 168 ax = aye 


The block diagram of Figure 5-4 illustrates the program. From Figure 5-4 


FIGURE 5-4 


it may be seen that two integrators and two multipliers are needed. How- 
ever, if a servo multiplier is available (and can be used in consideration of 
the speed of computation requirements), only one such multiplier would 
be needed since dx/dt is a common factor and may be used to position two 
ganged potentiometers, one to produce dy/dt and the other to produce 
Iz/dt. 

It may also be seen that with this method the function sin ax is also 

generated. In many applications this function would also be required. 


1Note the symbol |] used within a circle in the block diagram to represent multi- 
plication. If division is intended instead, the conventional arithmetic symbol (--) is affixed 
outside of the circle where the input arrow representing the divisor enters; in the absence 
of such a + symbol, multiplication is implied. 
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5-3 General Philosophy of Implicit Methods 


The implicit method of function generation is possible when there exists 
some mathematical conversion of the function to be generated that permits 
the use of simpler programs or equipment than would be required if the 
function desired was to be generated directly (i.e., explicitly). These mathe- 
matical relationships are not always clearly indicated, and finding them 
depends upon the ingenuity of the person establishing the program. One 
general example of this approach is the quarter-square multiplier described 
in Chapter 4. 


5-4 Implicit Methods Based upon Feedback 
About Infinite-Gain Amplifiers 


Functions that might be difficult to generate directly can often be produced 
if their inverse form is readily generated. For computers in general, the 
block diagram illustrating this method is shown in Figure 5-5. The algebraic 


r—+()}—-[a>= y 


FIGURE 5-5 


sign associated with the feedback summing point must be negative if the 
slope of g(y) is positive, and positive when the slope is negative. Then the 
output y will be related to the input x as follows: 
y= ux — 8(y)) (5-3) 
or 
y+ ug(y) = Bx 
However, as 4 — 00, g(y) —> x and 
y—se) as u~—oo (5-4) 
In other words, the inverse of the g(y) function has been generated. 
The infinite-gain element actually employed in analog computers is 
an operational amplifier without feedback. The gain then is actually y, the 
operational amplifier gain; ordinarily, however, this gain may be considered 
as equivalent to infinite on the basis of the same considerations as in Section 
2-2. 
For example, the circuit of Figure 5-6, or variations of it, is often 


a4 
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+o, 


employed. Here g(y,,) = (1/V,)(¥,,)?, where V, is the voltage rating of the 
computer. Hence g~'(x,,) = ./V,./x, and the square-root function has 
been generated (incidently, with an appropriate scaling) using a square- 
law function generator, This function generator need be of only the one- 
quadrant type since it would accommodate only positive x,,’s and y,,’s. 

It must also be pointed out that the net transmission in the feedback 
loop must always be negative. Positive feedback would simply drive the 
operational amplifier to another operating point or to overload. This con- 
dition of negative feedback is satisfied in the Figure 5-6 arrangement. 

In view of the above, the functions g(y) and g~'!(x) both must be mono- 
tonic. (In other words, in the strict mathematical sense, both must be true 
functions, not what are loosely called multivalued functions.) The difficulty 
that could be encountered otherwise is illustrated in Figure 5-7. In this 
arrangement, operation would be normal as long as x did not exceed x,. 
As soon as it did, the then-negative slope of the curve would result in a posi- 
tive-feedback effect driving y finally to y,, where equilibrium would take 
place. A similar jump effect would occur during the reversal of this process; 
as x was decreased again to less than x,, y would jump from y, to y,. The 
pattern of the y versus x response, therefore, would appear as in Figure 5-8. 


FIGURE 5-6 


aly) 
FIGURE 5-7 
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FIGURE 5-8 


This type of nonreversible pattern will prove useful for the generation of 
various discontinuous functions, as discussed in Chapter 6. However, it will 
not produce the inverse of g(y). 

If, unlike the situation of Figure 5-7, g(y) had been a function that 
did not again recover its positive slope, the positiye-feedback action would 
have driven the operational amplifier to overload. An example of a g(y) 
function that would cause this is shown in Figure 5-9. Here if x were to exceed 
x,,y would continue to increase until limited by the overload conditions 
on the amplifier. 


y 
FIGURE 5-9 


5-5 Negative-Feedback Methods Involving Functions 
of Two Variables 


If the function to be generated involves more than one variable, the implicit 
negative-feedback method may still be employed. For example, if the desired 
function z = f(x, y) is to be generated, two alternative implicit methods are 
available, shown in Figure 5-10. Which of the alternatives is employed 
depends upon convenience. The next section shows an example. 
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8, (¥, 2) = inverse of 
f(x, ¥) with relation- 
ship of z and x in- 
verted 


inverse of 


8, (x, 2 

S(x, y) with relation- 
ship of z and y in- 
verted 


FIGURE 5-10 


5-6 Division by Implicit Methods 


Suppose that the basic division operation is desired, z = y/x. Two alternative 
approaches are offered by Figure 5-10. g,(y, z) is the relation x = y/z and 
offers no advantages since it merely converts one division problem to another. 
On the other hand, g,(x, z) is the relation y = xz and is the one that would 
be employed if some form of multiplier (e.g., quarter-square, time-division, 
servo) were available. The block diagram and analog-computer program 
would then appear as in Figure 5-11. It should be noted that negative feed- 
back is maintained only if x,, is positive. If x,, is to be negative, a sign 
inversion should be incorporated in the multiplier to correct for this (—M 
type). Furthermore, as x,, approaches zero too closely, the difficulty of 
division by zero, common to all types of computers, is encountered. In this 
case an overload of the operational amplifier will result. To analyze this 
the worst case should be considered, where y,, = V,. Then 


2 
ee 


ae ae V; 
Xm 
or 
ieee 
The attenuation factor k used to reduce the y,, signal should comply with 


Ve 


mnin 


k> 


214 Implicit Methods of Function Generation Chap. 5 


=——© 


(a) 
kR 
Ym Beier 
R Fm EK Xm 
Xm2m 
V, 
Xm 
(b) 
FIGURE 5-11 


Suppose, for example, in a 10 V computer that 10 > x,, > 0.01 V OF Xmo:. 
= 0.01. Then k > 10/0.01 = 1000 and the division operation would be 


z, = 0.012" 
z,, then has the maximum permitted value of 10 V when y,, = 10 V and x,, 
= 0.01 V. 

In addition to the problem of overload when the divisor becomes 
too small, there is also the problem of decreasing accuracy of computation. 
To illustrate this let the circuit of Figure 5-11 be considered again with V, 
= 10and k = 1000, and with the gain of the operational amplifier considered 
as —y. Then actually 


ti Vine aa tebe 
7m = #6085 10 ) 


or 


Jes HY m is 
™ ~ 7000 + 100.x,, 


while the correct value of z,, would be 


0.01 


Yn 
Xm + 10/u 


Z, = 0.012" 


m 
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The per-unit error, therefore, is approximately 10/sx,,. As x,, has the mini- 
mum value of 0.01 V, 4 must then be at least 100,000 to maintain an accuracy 
of I per cent. Furthermore, and possibly more important, nu/l errors of only 
a small fraction of a volt can cause very significant errors in the quotient 
when the divisor becomes small. 

The range limitation of analog computers is a significant handicap when 
division is executed that involves divisors with large variations in magnitude. 
Digital computers do not show this same degree of disadvantage, although 
there, as well, there is the possibility of an overflow occurring if the divisor 
becomes too small. Digital computers also have the disadvantage that 
division is a much slower operation than multiplication and that whenever 
a program calls for this arithmetic operation, considerable additional execu- 
tion time is required. 

In general, the relative desirability of a multiplication operation in 
preference to a division operation is similar to the preference for integration 
rather than differentiation. Whenever it is possible to do so by proper plan- 
ning of a simulation model, multiplication is always the better choice. 


5-7 Polar Resolution Involving Sine—Cosine 
Generators 


Chapter 4 discussed resolvers (i.e., devices for obtaining the rectangular 
coordinates when the polar coordinates are given) performing the operations 


x=rcos@ (5-5) 

y=rsing (5-6) 
This could be done in an analog computer by a combination of electronic 
sine and cosine function generators in conjunction with multipliers. It is 
also accomplished conveniently and precisely by means of servo resolvers, 
mentioned in Appendix 4D, provided the response-speed requirements of 
the problem are sufficiently slow. 


The inverse operation, or polar resolution, normally consists of making 
use of the relations 


d= tan“ (5-7) 


r= /eFy (5-8) 
Both of these are awkward functions to employ directly. An implicit tech- 
nique is more convenient. From relations (5-5) and (5-6), 


x sin @ — ycos @ = r(sin@ cos 8 — sin @ cos 8) =0 (5-9) 


This is a converted form of relation (5-7) obtained by means of trigonometric 
identities. The desired operation is then as shown in Figure 5-12. 
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FIGURE 5-12 


This polar resolution technique can handle angles, @, within the range 
—n <6 <n. If the range is greater than this, the tan~! function is, of 
course, multivalued (not a true function). It is capable of handling both 
positive and negative rectangular components; note that, for example, x = 2 
and y = —2 will give the correct result of @ = —z/4, while x = —2 and 
y =2 will give the correct result of @ = +37/4. 

It is also important to observe that the net feedback will always be 
negative. To check this let the actual (as contrasted to the correct) value of 
6 be designated as @,. The input to the amplifier of gain yw is then 


—x sin 8, + ycos 0, =r(—sin @, cos @ + cos 8, sin 8) 
=rsin (6 — @,) (5-10) 


As only angles between —z and +2 radians are being dealt with: 


1. When @ — @, > 0 (i.e., 0, is less than the correct angle), a proper 
positive correction results. 

2. When 6 — 6, < 0 (i.e., 0, is greater than the correct angle), a proper 
negative correction results. 


This implicit solution of relation (5-7) is only one half of the polar- 
resolution problem. The other is the determination of r. This second opera- 
tion actually is now an explicit one, although relation (5-8) is not employed 
directly. Instead, use is made of the identity 
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x cos @ + ysin@ = r(cos? 6 + sin? 0) =r (5-11) 


This operation is combined with that of determining @ in Figure 5-13. The 
arrangement shown can produce difficulties when x and y become small, 
making r small as well. Relation (5-10) indicates that the input to the ampli- 
fier, of gain yz, is proportional to r for any given angular error. When r is 
too small, the feedback gain is reduced to the point where appreciable error 
could result. 

This difficulty is overcome by using a very high gain 4~ beyond what 
normally would be required (or be compatible with stable operation) when 
r is large. An automatic gain control (AGC) feature is then added, as shown 
by the dashed lines in Figure 5-13. This reduces the gain when r is large but 


x cos 6 


FIGURE 5-13 


permits it to increase when r is small, thus maintaining what is essentially 
constant-feedback loop gain. Obviously, this process has its limitation; 
cannot be made actually infinite, and when r becomes excessively small, 
the loop gain will still fall off and errors will result. Nevertheless, the 
range of r that can be accommodated is adequate for most simulation 
problems, 

Usually, the feedback connections required for this implicit method of 
polar resolution do not have to be planned by the programmer. Manufac- 
turers of commercial resolvers, both of the servo and solid-state electronic 
type, generally provide this feature, including the AGC feature described 
above. 
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5-8 Substitution of Fast Integrators 
for the Infinite-Gain Amplifier 


The methods of implicit function generation discussed up to now, involving 
infinite-gain amplifiers (“ — co), do not, of course, employ such hypothe- 
tical amplifiers in actuality. They employ, instead, operational amplifiers 
of very high gain. Under some conditions this gain is insufficient to establish 
a sufficiently high feedback-loop gain in the loop that establishes the func- 
tion desired. Hence computation errors result. In other instances it is neces- 
sary to reduce the gain because inherent response lags, even though very 
short, that exist in all functional amplifiers result in the feedback loop be- 
coming unstable. (An analysis of the conditions leading to such instability 
and the development of methods for avoiding such problems comes within 
the subject of feedback-amplifier design. It is an important consideration to 
those responsible for the design of analog-computer components but is not 
within the realm of this book.) 

Often, one way of avoiding this problem is to substitute fast integrators 
for the infinite-gain amplifiers. The procedure for converting the amplifier 
is simple and is shown in Figure 5-14. Since what formerly was an operational 


€ 


function hecomea function 


inputs 
P generated — Z generated 


FIGURE 5-14 


amplifier without feedback now becomes an integrator, infinite gain is 
achieved under steady-state conditions and it is theoretically possible for 
absolute static accuracy to be achieved; it is, of course, not completely pos- 
sible in practice because of inevitable null errors. Perfect dynamic accuracy 
is still not achieved because of the response lag introduced by the integrator. 
However, if C is sufficiently small, this response lag will be negligible in 
consideration of the significant response times associated with the machine 
solution of the problem being simulated. 


5-9 Avoiding Parasitic Oscillations in High-Gain 
Feedback Circuits 


One of the chief reasons for substituting fast integrators for raw operational 
amplifiers with implicit function generation is, as just mentioned, the avoi- 
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dance of parasitic oscillations, These are oscillations that occur because of 
the fact that all components involved do have some response lags (i.e., 
modifications of the amplitude response and phase shift with frequency). 
Therefore, the analog-computer program that might appear in theory to 
be perfectly stable may in practice be subject to such oscillations. These 
oscillations are almost always at high frequencies well beyond the range of 
the problem being simulated and therefore do not normally show up in 
output equipment, with the exception of cathode-ray oscilloscopes. Never- 
theless, these oscillations are likely to cause periodic overloads of a parti- 
cularly objectionable type, since the operator may not be aware of their 
existence. The moral of this is the advisability of always looking at the signals 
being produced by such high-gain amplifiers with a cathode-ray oscilloscope. 
The periodic overloads such oscillations cause can result in completely fal- 
lacious results. 

When a problem such as the above is encountered, the substitution of 
fast integrators sometimes, but not always, provides the solution. There 
is another technique that usually is more effective and is based upon the 
principle of phase-lag networks used to permit high loop gains in feedback- 
control systems without jeopardizing stability. This consists of changing the 
operational amplifier to the circuit shown in Figure 5-15. In this circuit 


Ry i 


input 
resistances 


FIGURE 5-15 


R, should be about +45 of the minimum input resistance employed. The 
capacitance C, is then selected as follows: The parasitic oscillations that 
occur prior to this modification are observed on a cathode-ray oscilloscope 
and their frequency measured roughly (within 20 per cent) and translated 
to radians per second, w,. The recommended value of C, is then given by 
the relation 
10 
C, = @,R; HE 


with R, being expressed in megohms. 

This procedure will normally result in introducing response lags in the 
amplifier only at frequencies much higher than those significant in the simu- 
lation problem. The circuit functions by sharply reducing the gain of the 
amplifier at the higher frequencies, particularly those involved in the genera- 
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tion of the parasitic oscillations, In almost all cases encountered, the circuit 
of Figure 5-15 has proved successful in eliminating such oscillations. 


5-10 Implicit Computations with Digital Computers 


Many function-generation problems that require implicit techniques with 
analog computers may be handled directly with digital computers. This will 
be true when the function involved can be described in some arithmetic 
way, or when it can be obtained from a library subroutine. 

There will, however, be instances when implicit techniques will be 
necessary with digital computation as well. Often a function g(y) is avail- 
able as an arithmetic operation or through an available subroutine, but 
its inverse, y = f(x), is required. In such an event implicit techniques are 
necessary. 

One example of this exists when g(y) is available as tabulated data 
with interpolation included in the table look-up procedure. Another is in 
the solution of equations where the inverse solution is not analytically expres- 
sible, as in many transcendental functions. As one example, consider the 
simple relationship 


x=g(y)= dy + fe™ (5-12) 


x is given. How is y found? The inverse function, y = f(x), cannot be 
expressed analytically. 


If this were an analog problem, it might be suggested that it be 
approached by a program as in Figure 5-16. Such a program would con- 
verge to produce the correct value of » and, if & were sufficiently large, 
this convergence would be sufficiently rapid to meet the simulation needs. 
With digital computers the same basic program might be suggested with a 
rectangular-integration procedure substituted for the continuous procedure 


FIGURE 5-16 
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of Figure 5-16. The program would then appear as in Figure 5-17. There, 
« corresponds to k Ar. As g(y) is almost always nonlinear, the stability 
(convergence capability) of such a program cannot be evaluated easily. 
However, for small perturbations about the correct value of y, it is possible 
to analyze this in terms of small increments of y and x, from their correct 


x= 


nt 
constant y(n) 


FIGURE 5-17 


values. This is shown in Figure 5-18 with A used to denote that such incre- 
ments are being considered. 

In Figure 5-18, A is strictly [x,(n + 1) — x,(n)]/[y(n + 1) — y(n)], but 
may be considered approximately as the slope of the g(y) relationship, or 
g(y), at the point y(n). An analysis of this situation by means of z transforms 
would show that 


Ay(n+ 1) 


FIGURE 5-18 


1. If ah < 1, the solution would converge in a nonoscillatory fashion, 
approaching the correct solution. The lower ah is, the slower the 
convergence. 

2. If wh = 1, the solution would arrive directly at the correct result. 

3. If | < ah < 2, the solution will converge in an oscillatory fashion 
upon the correct result. The higher af is, the “wilder” will be the 
oscillations and the slower the convergence. 

4. If ah > 2, the solution will diverge in an oscillatory fashion. 
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From the above results it may be seen that the margin of adjustment 
of the integrator gain @ is critical, since anything more than twice the opti- 
mum gain (% = 1/h) results in divergence. Apparently, this gain must be 
adjusted to be the inverse of &'(y) [i.e., what is estimated as the slope? of the 
g(y) relationship, or the constant A]. Two recommendations, therefore, can 
be made about a program that would implement this procedure: 


1. An automatic gain control feature is necessary so that is adjusted 
to be the reciprocal of h, i.e., to the value 


y(n) — y(n — 1) 
Xo(") — Xo(n — 1) 

2. As complete convergence cannot be expected in a finite number of 
iterations, there must be a specified maximum permissible error 
(called e,,); when the actual error (e =x —x,) is within this 
magnitude range, the computation should terminate. 


The fundamental portion of the digital program that would accom- 
plish this is shown in Figure 5-19. The flow diagram of Figure 5-19 conforms 
to the block diagram of Figure 5-17 except for the addition of the following 
features: 


1. A provision has been added for testing the error and accepting the 
value of y produced when error specifications are met. 

2. The integration factor « is adjusted to be the reciprocal of what 
amount to the best guess of the value of h = g’(y), based on the last 
two computations. That is, AGC has been added. 


Four more features must be added to make the computation procedure 
of Figure 5-19 a workable subroutine. 


1. There may be situations in which the computation will fail to con- 
verge and there must be a provision to stop the computation when 
this is observed. 

2. There will be situations when convergence exists but is too slow 
in consideration of the time limitations of the program, When a 
specified maximum number of iterations have been performed 


2If g(y) is known as an analytically defined function, g’(y) may, of course, be com- 
puted exactly. « would then, of course, be made equal to 1/g’(y). This procedure, known as 
Newton's method, would lead to a more rapid convergence. Unfortunately, with most simu- 
lation problems g’(y) is not expressible as an analytic function and a must be determined on 
the basis of finite increments, as is done here. This latter procedure, described here and the 
basis of the subprogram described in the next section, is essentially a version of the well- 
known Newton—Raphson method. 
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Xo(n) = gly(n)] 
(7) 
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y(n) =y(n — 1) + @e(n — 1) 


saving Xg before new value is computed 


FIGURE 5-19 


without reducing the error to within specifications, the computation 
is terminated. 

3. There must be some first guess of a to provide a starting value for 
the first iteration since « cannot be computed, as there will be no 
X.(n — 1) or y(n — 1). If the subroutine has been called previously, 
the last value of a that was employed may be a logical starting value. 

4. There must be a first guess regarding the starting value of y. Again, 
if the program has been called previously, the last value of y deter- 
mined may be the best first guess. 


5-11 An Implicit Subprogram 


It is convenient to employ a general subprogram that may be used regard- 
less of the nature of the g(y) function and the nature of the problem to which 
it is applied. Such a subprogram will be called here SUBROUTINE 
IMPLICIT. (The name of the procedure, for calling purposes, would depend 
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upon the computer language employed; IMPLICIT would have to be 
abbreviated to, say, IMPLCT, for Fortran.) Figure 5-20 is a flow diagram 
of such a program. 

Before the first call on this subroutine, the main program will specify 
the trial value of y to be used first and then compute the corresponding x, 
= g(y). At the first call it will transmit to the subroutine the permissible 
error in x, or é,,, the starting value of «, and will establish the number of 
tries (NTRIES) as 1. 

When the subroutine returns to the main program, it will do one of 
the following: 


1, If the error specification has been met, the logical variable, FINISH, 
will be made true (or the integer 1). This informs the main program 
that the last value of y furnished was correct within the error toler- 
ance. 

2. If the error specification is not met, the subroutine suggests a new 
trial value of y. NTRIES is counted up by one. The main program 
then computes the new x, and calls the subroutine again. 

3. If x,(n) — x,(n — 1) = Ax is too small, indicating approximately 
zero slope in the g(y) function, an overflow in the computation of 
a would result. Either a replanning of the main program or some 
other recourse is necessary. The subroutine, therefore, does not 
suggest a new value of y under these circumstances but, instead, 
sets the logical variable ZEROSLOPE to true (or to 1) to so inform 
the main program. 


The responsibility of setting initial trial values of « and y and of deter- 
mining when the number of tries (NTRIES) has become excessive is assigned 
to the main program. 

One implicit subroutine of this type could be used to handle a number 
of different implicit operations, either sequentially or in parallel. To accom- 
plish this in parallel would, of course, require that the common arguments 
be listed as members of arrays. 

Figure 5-21 shows how the main program would be arranged to make 
use of such an implicit subroutine. It should be noted that the program is 
permitted a maximum number of trials. Another test might be one of con- 
vergence; this test could be added easily to the implicit subroutine. Reference 
is made in Figure 5-21 to the prearranged corrective action to be taken 
whenever the zero-slope condition (discussed in more detail in the next 
section) is encountered or, because of slow or lack of convergence, an exces- 
sive number of trials is required. Usually such corrective action consists of 
changing the first trial values of y and «. How this is done depends upon the 
nature of the function being handled. 
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SUBROUTINE IMPLICIT( y,x,xo ,,esp, NTRIES, FINISH, ZEROSLOPE) 
LOGICAL FINISH, ZEROSLOPE 
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RETURN (for another trial) 
FIGURE 5-20 
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5-12 Graphical Description of the Implicit 
Procedure 


Figure 5-22 illustrates what occurs when this implicit procedure is used. 
Point | represents the point corresponding to the first trial guess of y and the 
resulting computed value of x, or x(1). The first error, e(1), is the vertical 
distance between this point and the actual value of x. «(1) times this distance 
is the horizontal projection to the next value of y, or (2). [In this example 
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actual curve of g(y) 


fe et Le( 1) 
No. 1 


No. 3 


correct 
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FIGURE 5-22 


y(2) 


it may be seen that «(1) was too large and the next point, point 2, is about 
as far in the other direction from the correct point as was point 1.] Point 2 
is the point on the true curve corresponding to this y(2) and the resulting 
computed x(2). The third iteration, in effect, projects upward from point 
2 back to point 1, and selects y(3) where this projection intersects the hori- 
zontal line corresponding to the correct x, and then projecting upward from 
this intersection determines, on the true curve, point 3 at the coordinates, 
[y(3), xo(3)]. It can be seen that a continuation of this procedure will bring 
the intersection points on the curve progressively closer to the correct point. 

This procedure can be an effective one requiring relatively few trial 
iterations (typically two to five) if the first guesses of y(1) and a(1) are reason- 
able, and if the function g(y) is monotonic (i.e., possesses a continuously 
positive or continuously negative slope). 

Even with monotonic functions, difficulties can be experienced with 
this procedure if the values of »(1) and «(1) are very far off. These difficulties 
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may consist of (1) an excessive number of iterations being required, or (2) 
an underflow or overflow of numerical quantities as they range beyond the 
numerical capacity of the computer. This second difficulty is particularly 
apt to occur with functions having rapidly changing slopes. 

Greater difficulties are encountered when the function g(y) is not 
monotonic, as this means that its inverse f(x) is not a true function and will 
have more than one solution. This was illustrated in Figure 5-8. In such an 
event, which solution will be found is a matter of chance and there is a 
strong possibility of an underflow or overflow occurring. Fortunately, in 
simulation problems such implicit programs will be employed during each 
time iteration and x will have progressed only a small increment from its 
previous value. Under these circumstances, once the first iteration has been 
successfully handled, the first guesses of y for later iterations of x will be 
rather good ones. 

An implicit subroutine based on the flow diagram of Figure 5-20 was 
used to establish the values of the iteration interval At that will result in 
a specified rms error of computation; this procedure was used for the 
experimental development of Table 3-4. The functional relationship that 
has been described here in general terms as g(y) then was 


€rms = S(At) (5-13) 


Here ¢,,, corresponds to x, in our general description. x now is the desired 
value of é,,, and is, of course, zero, y in our general description now becomes 
At. 

Relationship (5-13) cannot be expressed practically as an analytic 
function (except for very trivial examples where a z transform analysis might 
lead to such a function). It is developed only by actually repeating the 
simulation problem over a sample time range for each proposed value of 
At. By means of the implicit subroutine it was possible to establish the value 
of At that would produce a specified rms error and thus provide a means 
for comparing different numerical methods, as was shown in Table 3-4. 


5-13 Difficulties Encountered with Implicit 
Function Generation 


As is discussed in Chapter 6, some functions arising in simulation problems 
will invove discontinuities. A memoryless discontinuity is shown in Figure 
5-23. In such instances, difficulty will be encountered in meeting the error 
tolerance whenever x is specified in the discontinuous region. The implicit pro- 
gram just described will converge on y = y,, but the value of x, will fluctuate 
from one side of this discontinuity to the other during each successive trial 
computation; naturally, the error specification e,,, will never be met. 
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The recourse under such circumstances depends upon the context of 
this effect as it relates to the situation being simulated. In some instances 
it represents an error in constructing the program (x never should have been 
assigned a value in this range) and the program should terminate with a 
description of the difficulty. In other instances it may mean that y = y, is 
the correct result and the implicit computation should be considered as com- 
pleted successfully with this as the result. In such latter instances it is neces- 
sary to add an algorithm to the implicit program to recognize that this is 
the case. Such an algorithm is based on recognizing that an oscillation of 
finite magnitude exists between two essentially constant values of x,, with 
accompanying minute changes in the corresponding value of y. The mean 
value of y observed under such circumstances would be considered as the 
correct value. 

Even when g(y) is a continuous function, difficulties naturally would 
be encountered if a value of x should be specified that does not correspond 
to a real solution for y [e.g., x = g(y) = sin y when x = 2]. As this would 
indicate an error in planning the program or in the analysis leading to the 
program, the computations should then be terminated and would be ter- 
minated by the ZEROSLOPE condition. 

A more common difficulty is encountered when g(y) is not a mono- 
tonic function and, for some specified values of x, more than one solution 
for y exists. Which solution is reached by the implicit program will depend 
upon the trial starting values. On the other hand, which solution is the cor- 
rect one will depend upon the nature of the problem. Figure 5-24 pictures 
such a situation. For values of x between the maximum and minimum 
(i.e., x, < x < x,), three solutions, y,, y,, and y,, would all be correct mathe- 
matically; only one of these could be correct in terms of the context of the 
actual problem being simulated. If the first two trial values of y lie between 
y, and y, (the y locations of the maximum and minimum), the implicit 
solution would always converge on y,. If both trial values are less than y,, 
the solution would always converge on y,; if both are greater than y,, on 
y.. Other combinations of starting trial values lead to somewhat unpredict- 
able solutions that would have to be traced out (following the procedure of 
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Figure 5-22) in each specific case. In other words, if the context of the pro- 
blem calls specifically for one of these solutions as being the correct one, 
then it is important that the trials be started in the vicinity of the correct 
solution. 

In many instances involving multivalued solutions, the results that are 
obtained will depend upon memory (i.e., upon past history). The correct 
solution to the problem pictured in Figure 5-24 may be as shown in Figure 
5-25, In other words, if previous solutions for y have been less than y,, then 


a(y) 


FIGURE 5-25 


the correct solution for y, when x is as shown, would be y,. However, when 
x becomes greater than x,, the solution for y will jump (as shown by the 
arrow directed to the right) to the higher values of y. Then only when x 
subsequently is reduced to a value less than x, will the solution jump again 
(as shown by the arrow directed toward the left) to the lower range of y. 
In other words, the correct solution, when in the multivalued range, will 
depend upon past history. Under no circumstances would the correct solu- 
tion be y,. This type of jump and memory phenomena is discussed in more 
detail in Chapter 6. 
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5-14 Implicit Solution of Simultaneous 
Relationships 


Both analog and digital methods exist for the implicit solution of simulta- 
neous relationships’ of both linear and nonlinear form. The analog methods 
are, however, somewhat awkward to employ and can introduce stability 
problems, particularly when the number of simultaneous relations is large. 
Such analog techniques are described in the literature [1]. Digital techniques 
are generally better adapted for this purpose. 

The digital solution of linear simultaneous equations is, of course, 
straightforward and well known. The methods are generally based on matrix- 
manipulation techniques. A procedure will be described here, related to the 
well-known Newton-Raphson method, that will handle nonlinear simulta- 
neous relationships as well. It will be employed in Chapter 7 for the handling 
of boundary-value problems. The method is essentially an extension of the 
implicit subprogram described in Section 5-11. 

This digital method will handle simultaneous relations of the form 


[y] = f(b) (5-14) 


where [y] and [x] are vectors (arrays). In other words, for equations, 
v1) = file), (2), .. - , x(7)] 
y(2) = frlx(1), x(2), .. - , x(n)] 


y(n) = f,[x(1), x(2),... 5 x(n)] 
Given the desired values of the y’s (i.e., the y,,’s), the values of the 
x’s are found by means of the following steps: 


1. Starting values of the trial x’s (i.e., the x,’s) are assumed, estab- 
lished by the main program. The main program then establishes 
the corresponding y’s from the simultaneous relationships. 

2. The subroutine computes the errors in the y’s (i.e., their difference 
from the specified values) by the equation y,(i) = y,,(/) — y(/). 

3. A check is made of whether all these errors fall within the tolerance 
region. If they do, the original starting x’s were correct, the job is 
done, FINISH is made true, and the operation is returned to the 
main program. Normally this does not happen on the first trial. 


3The term “relationship” is preferred here rather than “equation” to indicate that the 
methods discussed are applicable to relationships established by computer simulation 
programs as well as those expressible algebraically. 
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4. 


14. 


135 


16. 


If the errors do not all fall within the tolerance region, a check 
is made as to whether the maximum number of trials has been 
employed. (This would naturally not be the case on the first trial.) 
If so, the subroutine prints out this information and terminates 
the program. 


. Unless this is the first trial, the values of the perturbation incre- 


ments, the Ax’s, are all divided by 2. 


. The values of the errors in y, or the y,’s, are saved as the B vector 


prior to perturbating the values of x and getting new y’s. 

The subscript of the x to be perturbated, (j), is first established 
as |. 

PERTURBATING, a logical variable, previously established as 
false in the main program, is now made true. 

The particular x to be perturbated is saved as X,y.. 

The reciprocal of the perturbation increment, Ax(j), is found to 
avoid repeated division. 


. The value of x,(j) is now perturbated by the specified amount 


Ax(j). 


. Operation is then returned to the main program for a computa- 


tion of the y’s based on the perturbated x. 


. After computing the new y’s, operation is returned to subroutine 


SIMULTANEOUS. The new values of the errors in y, the y,’s, 
are again computed (the values prior to perturbation having been 
saved in the B vector). 

Since PERTURBATING is true, operation is directed to step 15. 
Were it not, operation would have been transferred to step 3 for 
one more trial. 

The ratio of the change in the y,’s resulting from the perturbating 
of x(/) to the magnitude of x(j) is computed as the jth column of 
the A matrix. 

The value of the x, just perturbated is restored to its value prior 
to perturbation. 


. If all the x’s have been perturbated (i.e., / =m) the operation 


continues with step 19. Otherwise it goes on to 18. 


. j is “upcounted” by one and operation goes back to step 9 to 


start the perturbation of one more x. 


. Here all x’s have received the test perturbations. The complete 


A matrix relating the changes in the y’s to the test-perturbation 
changes in the x’s has been established. From this and the B 
vector that has stored the errors in y resulting from this trial, it 
would be possible to establish the changes of x, or the Ax,’s, 
that would reduce the errors in y to exactly zero if the relations 
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were linear. Since they usually will not be linear when this tech- 
nique is employed, the resultant changes in x will simply bring 
their values closer to the correct answer. What is done is to solve 
the simultaneous relationships expressed in matrix form as 


[A][Axo] = [B] 


This is done by calling a standard form of subroutine, called 
SIMQ, which solves /inear simultaneous equations. This subroutine 
is often a standard library program in larger scientific computer 
installations. It is, however, described in Appendix 5A for the 
benefit of those wishing to arrange their own subroutine. This 
subroutine finds the array of Ax,’s that would, if used to increment 
the previously used x,’s, bring them to exactly their prescribed 
values if the relations were linear. It converts the B vector to a 
vector containing these Ax,’s. 

20. The values of x, are now incremented by the amounts of Ax, 
prescribed by the preceding step. PERTURBATING is made false 
and operation is returned to the main program for a computation 
of the values of y resulting from these new recommended x,’s. 

21. When the subroutine is called again, since PERTURBATING is 
false, steps 2 and 3 are repeated and a new trial is conducted. 


The result of the above procedure is the establishment of values of 
X,’s that are closer and closer to the correct values (i.e., the values that 
will make the computed y’s equal to y,,). The procedures just described 
are shown in flow-diagram form in Figure 5-26. The steps in that diagram 
are numbered to correspond with those described above. 

There will be circumstances when the process described will not con- 
verge on a solution in a reasonable number of trials and may, in fact, diverge. 
The considerations governing this are similar to those discussed in Section 
5-13 for the implicit subprogram. Convergence can always be obtained in 
a reasonable number of trials for appropriate selection of initial x,’s and 
Ax’s; however, such a selection is not always easy to realize. Therefore, 
some maximum number of trials should be specified and the program stopped 
as unsuccessful after this number of trials has been made without the error 
tolerances having been met. 

The implicit subprogram for function generation discussed previously 
in this chapter is but a special case of the procedure described here for n = 
1. Figure 5-27 is an example of how such a subroutine might be employed. 
It should be noted that this subprogram constitutes a general-purpose 
module; it may be used for any set of simultaneous relationships provided 
the array dimensions are made adequate. 
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SUBROUTINE SIMULTANEOUS(1, x9, Ysp+ Ytoir YAX, FINISH, TRIALS, 
TRIALS max, PERTURBATING) 


nis number of simultaneous 
relations; Xo, Ax, Yop Vtov 


LOGICAL: FINISH indicates operation 
completed; tolerances have 
been met; 
PERTURBATING means 
that a perturbation test 
is being made 


Y, ¥,, and B are arrays of 
order n; initial x, n, ¥,,, 

Vio» TRIALSmax, and initial 
Ax are all furnished by the 
main program; on each call of 
this subroutine, the main pro- 
gram also furnishes the values 
of y resulting from the last 
suggested values of x 


DO fori=1 ton 


computation of 
errors in y 


Veli) =Vm (i) — vi) 


PERTURBATING 

? a trial has just 
been made with 
given x's 


error tolerances 
not met; consi- 
der another trial 


FIGURE 5-26 
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error 
tolerance 
test met 


main 
FINISH = true | program 
initially 
sets 
FINISH to 
false 


Printout fact 
procedure does 
not converge in 
specific number of 
trials 


start 
another 
trial 


RETURN 
(operation complete) 


start perturbation tests 


in process of 
perturbation 
tests; xo(/) 


just perturbated 


(15) 


reduce pre- 
I) Ax() = 0.5 + Ax() | Norterbation 
obtaining jth re aan 


column of A matrix 


FIGURE 5-26 (cont'd) 
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(6) 
DO fori=1 ton 


restoring 
value of 
xq to that 
prior to 
perturba- 
tion 


save errors in 

y based on values 
before perturba- 
tion tests 


start of count of 
perturbation tests 


main pro- 
gram ini- 
tially sets 
TRIALS 


#_ perturba- 
tions to 
continue 


TRIALS = TRIALS + 1 


pertur- pertur- to zero 
bations bate - 
com= ext main ‘arogtam 
leted initially 
a, ao PERTURBATING = true | sets 
PERTUR- 
BATING 
to false 


all elements of 
A matrix have 
been found 


save original 
value of xp 
prior to 
perturbating it 


solving for (19) (10) 

in equa- 2 R 
at CALL SIMQ (A, B, N) (Ax) = 1/Ax() 
[A] [Axo] = 

(B1; 
solution (1) increase xg 
array [Axo } ees )] by pertur- 
returned 20 Xo (i) = Xo(i) + Ax() bation in- 
as [B] (20) crement 


(12) 
RETURN 


DO fori=1 ton 
Ff Xo (i) = xo(i) + BU) 
all corrections of x complete 


PERTURBATING = false 


(21) 
RETURN 


perturbation tests over; 
see if new x’s satisfy 
relationships 


FIGURE 5-26 (cont'd) 
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Sample program for 

YC) =F, [x(1), x(2), x(3)] 

¥(2) =f, [e(), x2), x(3)] 

¥(3) =f, [x(1), x(2), x(3)] 
Given y(1), y(2), and y(3) as ¥(1),¥ (2), and Vp (3), the 
values of x(1), x(2), and x(3) are to be found. 


TRIALS ax 
TRIALS = 


FINISH = false 
PERTURBATING = false 


specified values of y either 
read in or generated in 
program 


p (2) Y gy (3) 
established 


error tolerances in matching 
actual and specified y’s 


starting trial values of x’s 
specified 


starting values of the per- 
turbation increments 


Execution of the simultaneous 
relationships; trial values 
of y generated based on Xq's 


either 


starting 

new trial 

or making Operation completed 
perturbation print out values of 


tests 


FIGURE 5-27 
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Suggested Problems 


5-1. x is a time-varying signal that has been provided by an analog program 
already established. A related signal is to be generated, y, where 

d*y 

dt? 
No dynamic-storage facilities or function generators are available, only 
simple diodes that might, for example, be used in absolute-value circuits. 
Multipliers are, however, available. Develop the analog program required, 
disregarding scaling but showing the application of initial conditions to all 
integrators used. 


+eoPtyax 


5-2. Several nonlinear function generators are available capable of gen- 
erating the function 50 log, x,,. However, there are no multipliers available. 
It is desired to produce the function 


Zn = 0.01% Vv where 0.01 < x,, < 100, 0.01 < y,, < 100 


‘m 


Show how this function might be produced. 


5-3. Figure 4A-1 shows a method for generating the function z,, = 
10-*x!-4y2. However, let it be assumed that the diode function generator 
producing the signal 10*/*° is not available, but additional fixed function 
generators of the type 50log,, are. Modify the program to handle this 
situation. 


5-4. The functions described in Problem 4-3 are to be generated. However, 
only fixed-diode function generators of two types are available: 


(a) logarithmic: ¥, = 0:50, log,o( =) 
i.€., Vq = 50 logis Xm for a 100 V computer 
= 5log,, (10 x,,) for a 10 V computer 
(b) square law: Vn = te 


r 


Develop these functions using only the function generators mentioned above. 
Diodes are not to be used, except in absolute-value circuits. 


5-5. Develop a program that will produce the nonlinear function y,, = 
k|(Xm + 1), where x,, is a given input signal within the range of 0 < x,, < 
V, volts. A signal representing dx,,/dt is also available. Select for both 100- 
and 10-V computers the maximum round value of k that will avoid overload. 
Do not use diodes or relay comparators. A multiplier may be assumed to 
be available. 
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5-6. Take scaling into account in this problem. Using a sine-cosine resolver, 
generate the function 


Vm = OLY, sec x 

for —84° < x < 84°. 
5-7. A function g(y) is known as follows: 

wimmig(y) ier + e™?? 
A digital program is desired that will provide the value of y when x is given 
within the range 0.005 < x < 200. Prepare such a program. The value of 
y is to be found so that the corresponding value of x, or x,, agrees within 
0.1 per cent with the value specified. Test such a program (i.e., find y) when 
x is 0,005, 0.01, 0.02, 0.05, ... , 50, 100, 200. 


5-8. Refer to Problem 1-1(c), where for a given annual rate of interest, 
R, the value of a bond where for a given annual rate of interest, R, the 
value of a bond at maturity (after 10 years) was to be computed when interest 
is compounded quarterly. As stated in Chapter 1, it was required to find 
by trial and error the value of R that would result in a doubling of the value. 
Now apply the implicit procedure described in this present chapter for the 
purpose of performing this trial-and-error operation. 


5-9. The input and output to a control system are related as follows: 
é + 10¢ + 100c = 100r 
The input is given as the following time function: 
r = 100 — 20e-**(cos 3t + cos 7t + cos 17t + cos 37t + cos 73t) 


c(0) and ¢(0) are zero. The response is to be simulated over an interval of 
2 sec. 

Actually, this problem is simple enough to permit a ready analytic 
solution. The solution is 


c= 100] 1 = e-*(cos 5./3t + wa sin 5/31) 


206-#(228 3t — cos5,./3t , cos 7t—cos5,/3t 
15 — 3? ; hb—7T 
4 £08 17t — cos 5,/3t , cos 37t — cos 5,/3t 
715 — 17° 715 — 377 
4. 908 73t — cos 5, ‘) 
75 — 73? 


Prepare a digital simulation program that can make use of any of the 
following methods of numerical integration: la-1, 2a-1, or 4a-1. With each 
of these methods find the value of Ar that will produce an rms error in the 
computation of ¢ equal to 0.1 + 0.005. 
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If facilities are available for measuring execution time with each of 
these methods (excluding any input or output time), compare the execution 
time required by each method when At is so selected. 


5-10. Consider the following set of simultaneous equations: 
y(1) = 3x(1)x(2) + x(3) = 12.50 
(2) = sin x(1) + exp [x(2)] = 3.317 
(3) = x(2) In x(3) = 1.609 


Use the digital method of Section 5-14 to find x(1), x(2), and x(3). 
Experiment with different starting values of the x’s and Ax’s and note the 
effect upon convergence of the solution. 


References 


1. A. S. Jackson, Analog Computation (New York: McGraw-Hill, Inc., 1960), 
specifically Chap. 9. 
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Appendix 5A: 
Subprogram for the Solution of 
Simultaneous Linear Equations 


There are a number of approaches to the problem of solving simultaneous 
linear algebraic equations; the one described here is a modification of the 
Gauss-Jordan elimination method.* The procedure used is described below 
with a simple illustrative example given. 


1, The n equations are presented in the form of an n x n matrix, A, 
and ann x | vector, B, That is, 


[A]bx] = [8] 
where [x] also is a vector of order n x 1, in other words, the array 
x(1), x(2),..., x(7). As an example, consider the equations 
3x(1) — 2x(2) + x(3) = 4 
2x(1) — x(3) =0 
x(1) + x(2) + x(3) =9 
‘3 —2 | “4 
[4J=|2 0 =1 [B] =|0 
jms 9 


4Bruce Arden, Jntroduction to Digital Computing (Reading, Mass.: Addison-Wesley 
Publishing Company, Inc., 1963), Chap. 14. 
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2. First, column 1 of A is selected as the first pivot column. All rows of 
A are examined to determine which has the first-column element 
with the greatest absolute value. This is then made the first pivot 
row. It is made row 1; if it was not row 1 originally, the elements 
are interchanged with those of the present row 1 (including the 
row | element of the B vector). In effect, nothing has been changed 
except that now the equations may be listed in a different sequence. 


In the example given above, the original row | element, A,, = 3, 
would be chosen as the pivot element and no interchange would be 
necessary. 


3. All elements in the pivot row (i.e., row 1) are divided by the pivot 
element. This included the B-matrix element in that row. In the 
example this would result in the A matrix and B vector becoming 


1 —0.666 0.333 1,333 
M2 0) 1 [B)=| 0 
1 1 1 9 


4. Every element of row | is multiplied by the pivot-column element 
of row 2 (in the example, by A,, = 2), and the resulting element 
then subtracted from the elements below in row 2. This will make 
A,, Zero. 

5. Step 4 is repeated but now with respect to the next row; i.e., every 
row | element is multiplied by A,, and the resulting values sub- 
tracted from row 3. The process is continued until performed with 
all the rows below the pivot row (still row 1). For the example 
being used the A matrix and B vector will appear as follows when 
this step is completed: 


1 —0.666 0,333 1.333 
[A] =| 0 1.333 —1.666 [B] = | —2.666 
0 1.666 0.666 7.666 


6. Step 2 is repeated but now with column 2 as the pivot column. 
All rows from 2 below are searched to find the maximum pivot 
and, if this does not appear in row 2, an interchange is made. Row 
2 (after such an interchange, if necessary) then becomes the pivot 
row. In the example being used the maximum pivot-column element 
appears in row 3, so an interchange is necessary. The A matrix 
and B vector will then appear as 


1 —0.666 0.333 1.333 
[A] =] 0 1.666 0.666 [B]=| 7.666 
0 1.333 —1.666 —2.666 
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Step 3 is repeated with row 2 as the pivot row, and then step 4, 
the subtraction operation now being performed on all rows below 
it. In the example the result as far as the A matrix and B vector 
are concerned would be 


1 —0,666 0,333 FP —lk338 
[4J=|0 1 0.400! [B]}=| 4.600 
0 0» =2200 —8.800_ 


7, Step 6 is performed again with all rows successively becoming the 
pivot row and corresponding columns becoming the pivot column 
until row n — 1 (row 2 in the simple example being used). 

8. Element A,, will be the last pivot. Only step 3 need be performed. 
For the example given the A matrix and B vector would appear as 


1 —0.666 0.333 1.333 
I47=|0 1 0.400) [8] =| 4.600 
Oe 1 4.000. 


The equations for this example are now in the form 
x, — 0.666x, + 0.333x, = 1.333 
x, + 0.400x, = 4.600 
x; = 4.000 
Note the triangular form of the A matrix. The solution for x(n) 
[x(3) in the example] has already been found. 

9. Now the back solution is performed, starting from the bottom row. 
This already holds (in the B matrix) the correct value of x(n). If 
this is substituted in the equations above it, x(m) will be eliminated 
and the correct value of x(n — 1) will appear in the B vector. This 
in turn may be substituted until the values of all the x’s appear 
as the vector B. The algorithm for this is shown in the flow diagram 
of Figure 5A-1. When all the back-substitution work has been 
completed, the B vector will appear as 


2.000 
[B] = | 3.000 
4.000 


[ie., x(1) = 2, x(2) = 3, x(3) = 4]. The flow diagram of Figure 
5A-1 shows the entire process described here. 


If ever a pivot element cannot be found that has an absolute value 
greater than the tolerance (set equal to 10°'° in this program), the matrix 
is singular and the equations have no solution, In this event (,,,, remaining 
zero), the subprogram prints out this fact and then halts execution. 
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SUBROUTINE SIMQ(A, B, N) 


do for pivots in all columns 


DO fork=1ton 


minimum permissible magnitude 
of pivot; row in which maximum 
pivot is found 


do for all rows from pivot 
row on 


max 


ABS[A(i, k)] >A 
? 


larger 
pivot 
found 


Tmax =! 


Amax = ABS[A(, k)] 


a satisfactory and maximum pivot 
element has been found if i,,,, #0 


PRINT “Matrix 
is singular” 


next row contains 
pivot; no interchange 
necessary 


FIGURE 5A-1 
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interchange 

kth and ijy 
TOWS 
do for all columns of 
A matrix 


SAVE =A (imax, /) 
A (imax si) = A (ki) 
A (k,j) = SAVE 


interchange 


SAVE =B (imax) 
B (imax = B (k) interchange in B vector 


B (k)= SAVE 


reciprocal of pivot 


do for all columns 
beyond pivot 


last pivot; no 
division of other 
A matrix elements 
necessary 


also divide the B element 
in this row by the pivot 


BC B (k) * RPIVOT| 


last pivot; no 
subtraction necessary 


FIGURE 5A-1 (cont'd) 
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do for all rows 
below pivot 


DO fori=k+l ton 


do for all columns 
to right of pivot 


DO forj=k+1 ton 


A(i, j) = A(i, j) — Ali, k)*ACk, f) 


B(i) = B(i) — A (i, k)*B(k) 


matrix now in triangular form 
with pivot elements all unity 
do for all pivots 
from bottom to top, 
except first 


back substitution 
DO fork =n to2 by —1 


do for all rows above 


DO for!=k — Ltolbyal the pivot element 


back-substitution 


BU) = BW) — AG, K*B(K) | steorithm 


RETURN 


FIGURE 5A-1 (cont'd) 


Simulation of Discontinuous 6 
Relations 


6-1 Instances Where Discontinuous Relations Occur 


When the subject of discontinuous relations arises in regard to physical 
systems, first thought is normally given to such common phenomena as 
electrical-relay operation or mechanical limit stops. There are many more 
examples bound to arise in practical simulation problems. Other physical 
examples are limiting in the electrical sense, mechanical free play or back- 
lash, Coloumb friction, stiction, and other effects. In linear programming 
(as applied to operations research as well as to physical simulation problems), 
the constraints that constitute a basic part of the problem are a form of 
limiting. The representation of such discontinuous effects on either an analog 
or digital computer is an important part of the general subject of simulation 


6-2 Limiting 


Limiting may for example, occur as a saturation effect in an electrical 
amplifier, as in Figure 6-1. This is soft limiting; it does not represent a dis- 
continuous relationship and generally is simulated by function-generator 
techniques treated in Chapter 4. 

Hard limiting is less likely to occur in electronic components, such as 
amplifiers, unless introduced purposely by some switching means, but occurs 
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fou 


ein 


FIGURE 6-1 


frequently in mechanical systems. It is shown by the relationships in Figure 
6-2. It should be noted that the two abscissa values at which limiting occurs, 
x,(1) and x,(2), need not be of the opposite sign. The examples of Figure 
6-2 represent bilateral limiting; unilateral limiting can also occur. Strictly 
speaking, these relationships are not discontinuous (although they are 
mathematically nonanalytic); they are discontinuous only in their slope. 
Nevertheless, it is convenient to include such a limiting phenomenon among 
the items discussed in this chapter. 


x, (1) x, (2) 


(a) (b) 


FIGURE 6-2 


A variety of analog techniques is available for simulating such limiting. 
Two examples are shown in Figure 6-3. Both examples apply to the instance 
where x,(2) is positive and x,(1) is negative (as in Figure 6-2a). If either one 
of these quantities should be assigned the other algebraic sign, it would be 
necessary to apply the reference voltage of the sign opposite to that shown 
in the diagram (the diodes, however, maintain the direction shown), 

In Figure 6-3a it should be noted that the bias voltages are not applied 
directly from the potentiometer that establishes them but rather through 
inverting amplifiers. The purpose of this is to provide the lowest possible 
source resistance associated with these bias voltages. Any significant bias- 
supply resistance results in imperfect limiting in that the slope of the y 
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=F 


-V, 4+V, 
(a) input limiting with (b) output limiting with 
shunt diodes feedback diodes 


FIGURE 6-3 


versus x relationship, as shown in Figure 6-2, would no longer be zero (hori- 
zontal) but would acquire some positive slope. 

In Figure 6-3b this isolation of the potentiometers is not done; the 
source resistance represented by the floating potentiometer adds to the 
effective series resistance of the diode and causes the slope of the y versus 
x relation to be finite rather than zero in the limited range of operation. 
This effect might be avoided by the use of inverters operated from the outputs 
of the floating potentiometers, but then a second inverter would also be 
necessary in the feedback loop to maintain the negative sense of the feedback. 

When applying the circuit in Figure 6-3b, the proper potentiometer 
settings, %, and @,, are given by the relation 


Ve 
a, Toes 
In most practice these settings are not established by this relation but rather 
by a trial-and-error adjustment while the limited output is observed on a 


voltmeter. 
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When absolutely sharp limiting is required, a circuit employing ideal 
diodes could be used. An example of such a circuit is shown in Figure 6-4. 

In addition to those techniques employing diodes, comparators may 
be employed to simulate limiting. Figure 6-5 shows such an arrangement. 

All the examples shown (Figures 6-1 to 6-5) relate to limiting when y 
is equal to x within the unlimited range. As a matter of fact, other operations 
may be combined with limiting. A gain factor could be introduced or the 
output amplifier could be employed as an integrator. In such instances there 
is a significant difference between input-limiting techniques, examplified by 
Figures 6-3a, 6-4, and 6-5, and output limiting, examplified by Figure 6-3b. 
In the former instance, x is limited; in the latter, y is. This is especially impor- 
tant when integrators are combined with limiting as then, with input limiting, 
it is the integrand that is being limited, whereas with output limiting it is 
the integral itself. 


R 
FIGURE 6-4 
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FIGURE 6-5 


6-3 Digital-Comparator Module 


Discontinuous effects may be simulated with digital equipment by using 
the digital equivalent of a comparator. For example, Figure 6-5 could be 
used as the basis of logic for simulating hard limiting by digital means. 

A digital-computer version of a comparator is somewhat more com- 
plicated than it might appear at the outset. With digital simulation, the 
iteration intervals are specified on the basis of such considerations as required 
accuracy and required interval of printout. With methods such as Runge- 
Kutta this interval may be quite large. It is completely unlikely that a com- 
parator will be actuated at exactly the end of any given iteration interval. 
However, it is important that the instant of time of comparator transition 
(actuation or deactuation) be established. This suggests a temporary varia- 
tion of the iteration interval and a search for the transition instant. 

Figure 6-6 is a flow diagram illustrating the operation of a general- 
purpose comparator module. It may be used to simulate any number (COMPS) 
of independent comparator units. The input signal to the comparator will 
be called here SIG; this is equivalent to the sum of the voltages applied to 
an analog comparator. When SIG > 0, the comparator is actuated (ACT = 
true); otherwise, it is deactuated (ACT = false). 

At the first iteration of the simulation program (STATUS = 1), the 
actuation state (ACT) of each comparator is established. After each sub- 
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SUBROUTINE COMPAR(ACT, SIG, At, TOL, 
MAXTLS, STATUS, SEARCH, COMPS) 


STATUS = | starting first iteration 
COMPS is number of comparator units interval 
handled. SIG (i) is actuating signal to the / th = 2 starting new series with 
comparator. ACT (i) (logical) is actuated state normal interval 
of i th comparator. TOL (i) is tolerance of = 3 continuing iterations 
range of SIG (i) within which transition might with normal interval 
occur. MAXTLS is maximum number of trials = 4 search for comparator 


permitted in search for transition instant. transition just completed 


= 5 search for comparator 
transition 


searching for transition 
time of comparator # SEARCH 


af 


STATUS = 2 


check whether any 
comparators have 
tripped during last 
interval 


establishing 


tial actu- so far, no 


comparators 
observed to 
have tripped 


saving present 
actuating signal 


RETURN 


FIGURE 6-6 
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SIG (i) $0 
? 


did not 
trip 


OLDSIG SIG (i) 


OLDSIG(i) = —TOL(i) OLDSIG(i) = TOL(i) 
? * 


tripped at exactly tripped during 


SEARCH preceding iteration interval 
(integer) instant 
is no. of 


compara- SEARCH = | 
tor for SIG (i) 
wich Ar= At OLDSIG Gi) — SIGG) count 
eed TRIALS = | compara- 
potitis STATUS = 5 tors that 
being Sal 
sur eg., 
searched TRIPS = TRIPS + 1 CHANGE(3) 
CHANGE(TRIPS) = i is number of 
STATUS = 5 third com- 
parator 
RETURN observed 
to have 


tripped 


FIGURE 6-6 (cont'd) 
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at least one com- 
parator tripped 


=5 


search for transition instant 
of comparator that tripped first 


SEARCH = CHANGE(1) 


no comparators 
tripped this 


tentatively plan to search 
interval 


for transition instant of 
comparator first observed 
to have tripped 


RETURN 


more than one com- 
parator tripped; 
necessary to find 
which tripped first 


only one com- 
parator tripped 


trip ratio: com- 
parator where this 
is a maximum is 
assumed to have 
tripped first 


OLDSIG (SEARCH — SIG (SEARCH) 
OLDSIG (SEARCH) 


MAX = | 


do for the second and all 
later comparators observed 
to have tripped 
identification number of kth 
comparator observed to have 
tripped 


DO for K = 2 to TRIPS 
L=CHANGE(K) 


trip ratio of this 
comparator; is this 
a new maximum value? 


RATIO = | OLDSIG (L) — SIG (L) 


OLDSIG (L) 


EARCH = L i f 
MAX = RATIO assign search 


for transi- 
tion point to 
this comparator 


> of comparators 
RATIO S$ MAX tested, this tripped 
9 first 
Ss tentatively 


FIGURE 6-6 (cont'd) 
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transition 
point has 
been found; 
reverse state 
of comparator 
# SEARCH 


ACT(SEARCH) 


STATUS =4 


DO for i= 1 to COMPS 
is OLDSIG(1) = SIG() 


RETURN 


false —“ ACT(SEARCH) >>128 
2 


search just 
completed 
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transition point of 
comparator # SEARCH 
is to be found 


TRIAL 


this is first 
trial in search 


already searching for transition 
point of comparator #SEARCH 


transition point 
not yet found 
within tolerance 


TRIALS = MAXTLS 
2 


more 
trials 
aaa maximum 
permitted 
search 
trials 
made 


print out that 
maximum trials 
have been made 


STOP 
TRIALS = TRIALS + 1 


FIGURE 6-6 (cont'd) 
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temporary Af used in 
search; see relation 
(6-13); always nega- 
tive on first trial 


Ns ____ SIG(SEARCH) 


* OLDSIG(SEARCH) — SIG(SEARCH) ek 


save present actuating 
signal of comparator 


OLDSIG(SEARCH = SIG(SEARCH) 
being searched 


RETURN 


FIGURE 6-6 (cont'd) 


sequent iteration, a test is conducted to determine whether a transition has 
occurred (SIG has changed sign). All comparators are checked as more 
than one may have undergone a transition in the preceding interval. If this 
should be the case (TRIPS > 1), a test is conducted to establish which 
comparator first underwent a transition. This test is based on a linear esti- 
mation of the time of transition, ¢,, as measured from the beginning of the 
last iteration interval. This estimated value is established as 

- SIG(n — 1) 

n= | STG@— )— rel = (6-2) 
where SIG(n — 1) is the value of the actuating signal at the beginning of 
the interval (designated as OLDSIG in the flow diagram) and SIG(m) is the 
value of the actuating signal at the end of the interval. Whichever comparator 
has the lower value of ¢, is assumed to have tripped first. [In the program 
represented by the flow diagram, the reciprocal of the quantity in brackets 
in relation (6-2) is evaluated instead and the search then is for maximum 
value.] 

Once it has been established which comparator tripped first, a search 
for the transition instant of that comparator is initiated. (The integer, 
SEARCH, is the identification number of the comparator being searched.) 
Linear intepolation is again employed, now to estimate the next iteration 
interval that would be required to reach the instant of transition. Since the 
last iteration normally would have been beyond this point, the first search 
iteration interval established by this procedure normally would be negative. 
(It might be noted here that the integration modules described in Chapter 
3 operate as well for negative as for positive time iterations; it is possible 
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to backtrack.) The relation used to establish the size of the search iteration 
interval is 
ae SIG(n) 

Ate — 1) = srg ey Ga Ae) (6-3) 
The next to last operation shown in Figure 6-6 is the computer version of 
this relation. As the search procedure is based on linear interpolation, the 
first trial search normally will not be successful; further trials based on the 
same interpolation relation will be required. A successful search is one 
where the actuation will be required. A successful search is one where the 
actuation signal, SIG, is zero within specified tolerance limits (TOL in the 
flow diagram). A limit (MAXTLS) is imposed upon the number of search 
trials permitted; this is specified in the main program. 

The comparator subprogram always disturbs the normal iteration pat- 
tern and it is desirable to return to this pattern after a transition point has 
been established and appropriate action taken. For this reason, an accom- 
panying subprogram, SETDT, should always follow. The flow diagram of 
such a program is shown in Figure 6-7. 

The SETDT routine has not been combined with the COMPAR sub- 
program because it sometimes is desirable to have the main program change 
the value of the normal iteration interval, DTSPEC; this may be determined 
by the comparator states. A later example will illustrate this. 

Figure 6-8 shows how the main-program flow diagram would be modi- 
fied in order to include such a combination of COMPAR and SETDT sub- 
programs. The statements shown must be added to the initialization process. 
Then, following any last pass of the integration procedure, the comparator 
subroutine will be called. If any comparator states have changed, the program 
then establishes any new conditions (such as the engagement of a limit stop) 
that might have occurred and changes any relationships affecting the output- 
response variables that might result. It may also establish whether the speci- 
fied value of Ar should be changed because of any comparator transitions 
and notes whether any special printout should be called for even though it 
is not the intended time for such a printout. (Printouts are generally desirable 
following any significant change in comparator states.) The SETDT sub- 
routine is then called; this will play a role only following a comparator 
transition or when searching for the transition instant. The program 
then follows the general pattern of Figure 3-13 except for the added provi- 
sion of an extra printout being possible when a comparator transition has 
occurred. 

Because of the variable (and often negative) iteration intervals that 
occur during the search procedure, extrapolating types (“b” types) of numer- 
ical integration techniques generally are not suitable when the comparator 
module is employed. Furthermore, extrapolation methods are generally 
not desirable when gross discontinuities arise, as often is the case when 
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SUBROUTINE SETDT(STATUS, DTSPEC, AT, NEWDT, T) 


DTSPEC is the normal iteration 
interval being called for by the 
main program 


= 5 search continuing 


never will be 1 


At estab- 
lished by 
COMPAR 
subprogram 


normal iteration pat- 


transition 
tern being resumed =2 


point just 
found; spe- 
cify tempo- 
rary At to 
return to 
normal it- 
eration 
pattern 


=3 
continuing with 
normal Ar 


At = DTSPEC 


Nis number of 
normal inter- 
vals to last 
iteration point; 
TNEXT is next 
iteration point; 
At is necessary 
size of tempo- 
rary At 


N=t/ DTSPEC 
(truncation) 
TNEXT =(N + 1) *DTSPEC 
At = TNEXT —t 


RETURN 


RETURN 
FIGURE 6-7 


comparators are involved in the program. The methods of Chapter 3 
described as la-1, 2a-1, 3a-1, and 4a-1 all function well with such a com- 
parator module, 

One example of the application of comparator modules is the estab- 
lishment of instants when various dependent variables attain specified values. 
For example, Figure 1-34 represents a printout of the results of a simulation 
study relating to the Chapter 1 example. Suppose the instants that the vari- 
able y was equal to 1.000, 2.000, 3.000, etc., happened to be of interest. The 
output results listed in Figure 1-34 do not show these precise instants. How- 
ever, by including a comparator module designed to be actuated whenever 
y achieves some integer value, these instants could easily be included in the 
printout. A printout would then be called for whenever a comparator transi- 
tion was noted. 
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Other initialization procedures shown in Section 3—14 


STATUS = 1 
COMPS are specified 

TOL() specified for each comparator 

MAXTLS (max. search trials) specified 

initial DTSPEC specified 


comparator 
initialization 
return to start 
anew run 
iterative return 


Determine new values 
of time dependent 
variables and para- 
meters 


Establish values of all 
signals affecting com- 
parators 


Call comparator subprogram 


establish, on basis of comparator 
states, any conditions affecting 
integration inputs that call for 
a special printout or that changed 
the specified Ar (DTSPEC) 


Call SETDT subprogram 


FIGURE 6-8 
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integration subprogram 
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6-4 Digital Simulation of Limiting 


Figure 6-5 may be used to establish the method for simulating limiting by 
digital means once a comparator subroutine module is made available as 
described in the preceding section. The procedure should be obvious from 
this diagram. The limited output, called y in the example, is established 
after the comparator subroutine is called. Suppose, as shown in Figure 6-5, 
that comparator | establishes the lower limit [x,(1)] and comparator 2 the 
higher limit [x,(2)]. Then SIG(1) would be x — x,(1) and SIG(2) would 
be x — x,(2). Then 


if ACT(1) = false, then y = x,(1) 
if ACT(1) = true, then 
if ACT(2) = false, then y = x 
if ACT( 2) = true, then y = x,(2) 
The appropriate expression relating » to x would continue to be used until 


the next time that the comparator module indicated a transition (STATUS = 
4). 


6-5 Inactive Zone 


Many phenomena to be simulated involve what is variously called an inac- 
tive zone, a dead zone, an inert zone, etc. The significance of this effect is 
shown in Figure 6-9. This effect can arise from a number of reasons, includ- 
ing free play in mechanical couplings, linkage, and gearing. Figure 6-10 
shows an analog program for simulating this effect based on the use of com- 
parators. Figure 6-11 illustrates four techniques for simulating such an effect 
by means of diodes. Among them, method (a) is the simplest but can be 
employed only with computers that have floating power supplies available. 
Method (b) also is simple, but the potentiometers add to the effective diode 


, (as plotted here, A(1) 
would be algebraically 
negative) 


FIGURE 6-9 
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FIGURE 6-10 


resistance and will cause some slight modifications of the slope when operat- 
ing beyond the inactive-zone range. (The input resistance of the next ampil- 
fier, therefore, should be large compared to the potentiometer resistance.) 
Method (c) avoids this difficulty but required three amplifiers. Methods (a) 
to (c) will all exhibit some rounding of the corners (referring to the plot of 
Figure 6-9) at the inactive-zone boundaries; this may be avoided by the use 
of ideal-diode circuits, illustrated by Figure 6-11d. 

The digital simulation of the inactive zone is based on the same type 
of logic as represented by Figure 6-10, except that the inversions peculiar 
to analog-type amplifiers need not be considered. Say that the comparator 
module is employed with SIG(1) =x — A(1) and SIG(2) = x — A(2). 
Then 


if ACT(1) = false, then y = x — A(2) 
if ACT(1) = true, then 
if ACT(2) = false, then y = 0 
if ACT(2) = true, then y = x — A(1) 
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6-6 Two-Position Contactor 


The two-position-contactor effect, also described as a “bang-bang” effect, 

occurs frequently in simulation problems, Its general nature is illustrated by 

Figure 6-12. Its mathematical description is obvious: 
yl) when x < x, 


= 6-4 
= (2) when x > x, - 


FIGURE 6-12 


One frequent example of this effect relates to Coloumb friction, where the 
friction force (or torque) is of a constant magnitude but of a direction that 
depends only on the algebraic sign of the relative velocity » between the 
moving parts; i.e., 


te —f, when v < 0 
alee when v > 0 


In this instance the relationship shown in Figure 6-12 would appear as an 
odd function with x corresponding to v, y to f,, (1) to —f,, and y(2) to +f,. 

The programming of such an effect in a digital program is obvious. 
Also obvious is its analog programming when comparators are employed. 
If diodes are used instead, the programming problem is slightly more com- 
plicated. One approach is to use a finite, but high, slope in what should in 
Figure 6-12 be the vertical transition from the (1) to the y(2) level. The 
analog simulation of this then combines a high-gain amplifier with limiting. 
Figure 6-13 shows schemes that may be employed where the high-gain ampli- 
fier is an open operational amplifier. 

In applications of the Figure 6-13 circuits, y(1) is, more often than not, 
a negative quantity. Then the polarity of the y(1) floating power supply in 
(a) or of the voltage applied to the (1) adjustment potentiometer in (b) 
would be reversed; the directions of the diodes would not be reversed from 
those shown. The use of these circuits substitutes a line of slope wz (where 
# is the gain of the operational amplifier) for the vertical transition from 
y(1) to 3(2) in Figure 6-12. 


(6-5) 
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¥(1) adjustment 


-~y 


y(2) adjustment’ 


(a) (b) 
FIGURE 6-13 


With some operational amplifiers, the use of the circuits shown in 
Figure 6-13 could lead to parasitic oscillations. For this reason the output 
should always be observed on a cathode-ray oscilloscope to ascertain that 
this is not the case. When this difficulty does arise, it can usually be cured 
by the methods discussed in Section 5-9. In some instances even this will 
not suffice and it is then necessary to reduce the effective gain of the opera- 
tional amplifier by adding a small amount of negative feedback to the circuits 
of Figure 6-13 in the manner shown in Figure 6-14. 


R 


gain = 1/k 


FIGURE 6-14 


6-7 Three-Position Contactor 


In general, multiposition-contactor effects (i.e., extensions of the relation- 
ships shown in Figure 6-12) can be simulated by the same basic procedures 
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a 


y)<0 
in this example 
o 


FIGURE 6-15 


as have just been described. One special case occurs frequently, a three- 
position contactor with zero output for the midposition. This is shown in 
Figure 6-15. Often the operation is symmetrical [i.e., y(1) = —)(2) and 
A(1) = A(Q2)]. This effect occurs in electrical-contactor equipment and in 
mechanical clutches; its equivalent appears in many other phenomena, 
including those of a nonphysical nature. The midrange between —A(1) and 
A(2) is referred to as the inactive zone. Although this zone may be inherent 
in the mechanism being simulated, it is often introduced purposely to pro- 
vide a range within which the mechanism can rest. 

The technique for simulating this effect in a digital program or by 
employing analog comparators is obvious and need not be described here. 
Analog simulation by means of diodes may be based on the viewpoint that 
the function being represented is a combination of a two-position contactor 
and an inactive zone. Figure 6-16 illustrates a general procedure that may be 
employed for the simulation of this effect. 


two-position 


(not needed if 
A(1) = A(2)} 


FIGURE 6-16 


6-8 Attaining Infinite Slope in Contactor Simulations 


In the preceding two sections relating to multiposition contactor simulation, 
those circuits that employed diodes had the disadvantage that the slope of 
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the y versus x relationship was not truly infinite; unlike the digital scheme 
and schemes using comparators, an immediate transition from one output 
level to another was not obtainable. This might be a disadvantage in some 
simulation problems but can be overcome by making the amplifier one of 
the infinite-gain type by employing the unity positive-feedback principle 
shown in Figure 6-17. 


is equivalent to =| 


FIGURE 6-17 


If this principle is combined with limiting, an infinite slope (i.e., an 
abrupt transition from one level to the other) will result in the transition 
region. This is shown in Figure 6-18 as applied to the two-position-contactor 
simulation problem represented by Figure 6-12. The circuit of Figure 6-18 
happens to employ the shunt-diode input type of limiter of Figure 6-3a. 
Actually, any other type of limiting circuit could have been used as well. 
The reference-supply connection, +V,, to the three potentiometers establish- 
ing x,, (1), and (2) will be +V, or —V,, depending upon the algebraic 
sign of those quantities. 

A true vertical slope will be obtained (with reference to Figure 6-12) 
at the transition point only if the feedback gain is exactly unity. Obviously, 
this cannot be exactly the case. If less than unity, some finite slope will result; 


unity positive-feedback connection 


R 


+V, +V, +V, 


FIGURE 6-18 
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if more than unity, a hysteresis or detent action, to be discussed later, will 
result, The circuit of Figure 6-18, therefore, is sometimes modified by pro- 
viding a vernier control of gain in the feedback connection so that a rea- 
sonably precise adjustment of unity feedback gain may be achieved. 

This difficulty of obtaining precisely an infinite slope is not necessarily 
a disadvantage in simulation. Most physical effects being simulated do not 
possess this characteristic; their transition from one level to another usually 
occurs in terms of either a steep but not infinite slope (less than unity feedback 
gain in the Figure 6-18 circuit), or in a hysteresis effect (corresponding to 
slightly more than unity gain). 

A three-position-contactor simulation of the characteristic shown in 
Figure 6-15 can be obtained by an extension of the Figure 6-18 circuit. This 
is shown in Figure 6-19. There the two grounded diodes may appear to be 
superfluous; actually, they guarantee that there will be no y output when 


+V, 


FIGURE 6-19 
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x is within the inactive-zone range [i.e., between —A(1) and A(2)]. Again, 
while a shunt-diode input-type limiter is shown in Figure 6-19, other types 
of limiting circuits could be used instead. 


6-9 Hysteresis in Discontinuous Circuits—The 
Acquiring of Memory 


It has been stated that in a circuit of the type shown in Figure 6-18, had less 
than unity feedback gain been used, a finite rather than infinite slope would 
have resulted, and had more than unity gain been used, what has been referred 
to as a hysteresis effect would occur. This general effect of positive feedback 
can be explained by redrawing Figure 6-18 in a more general form, as in 
Figure 6-20. The implementation of that figure could employ any limiter 
with the characteristics shown. To understand its operation the steps of 
graphical analysis shown in Figure 6-21 should be considered. In (a), the 


limiter portion of Figure 


6-18 circuit 
FIGURE 6-20 
x 
slope (x ty) 
unity vs. y 
7 
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FIGURE 6-21 
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input to the limiter, x + y, is plotted versus the output, y. Superposed is 
a plot of y versus y itself, naturally a line of slope unity. The plot of y is 
then graphically subtracted from that of x + y to obtain the plot of x 
versus y shown in (b). In (c) the inverse relation is shown, or of y versus x. 
This is the output-input relation of the complete circuit and it may be seen 
that a sudden transition does take place between the (1) and y(2) levels. 

Now let the general concept of Figure 6-20 be considered again, but 
this time with a feedback gain #, where # may be greater or less than unity. 
This is shown in Figure 6-22. Let the case where f < / be considered first. 
The graphical construction shown in Figure 6-21 would now be modified to 
that of Figure 6-23. As has been stated, a finite rather than infinite slope 
results as far as the output-input relationship is concerned; this slope is 


equal to 1/(1 — £). 


limiter portion of Figure 
6-18 circuit 


FIGURE 6-22 
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FIGURE 6-23 
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Finally, let the case where 8 > | be considered. The graphical con- 
struction then becomes as shown in Figure 6-24. 

Diagrams (a) and (b) of Figure 6-24 result from the same thought 
processes. Going to (c) requires some reflection. It should be recalled from 
Chapter 5 that the feedback effect results in an implicit solution for y [i.e., 


x x 


(x + By) vs. ¥ 


A BY VS. y 
" Xe —(B— 1) y (1) 
i Xe — (B= Ny (2) 
yD 2) yy ¥(2) 
(a) (b) (c) 
B>1 
FIGURE 6-24 


y will automatically adjust itself to whatever value is required to match the 
input x in accordance with the relations plotted in (b)]. Say, for example, 
that x is increasing from some negative value. From (b) it may be seen that 
y will initially maintain its value at (1). This situation will continue as y 
is increased until x goes just beyond the value x, — (B — 1)y(1), or the 
first trigger level. At this point, y will jump to the point where it again 
attains a value sufficient to match the value of x [i.e., where y = y(2)]. Sub- 
sequent increases in x result in y remaining at the level y(2). 

If y should be decreased, the value of y required to satisfy the input 
x will, according to (b), remain (2) until x is decreased to a level below the 
previous trigger level [i.e., below x, — (8 — 1))(2)]. Then y will jump imme- 
diately to the level y(1). This is also shown in (c), where arrows have been 
added to the vertical lines representing the jump transitions to show the 
one-way path involved. The phenomenon described here is similar to that 
illustrated by Figures 5-7 and 5-8. 

The circuit has now acquired memory, at least a one-bit memory. In 
the hysteresis region between x, —(B — 1))(2) and x, — (B — 1)y(1), 
whether y is at the y(1) or (2) level depends upon its past history. 

There is nothing new about the hysteresis phenomenon. It is a form 
of flip-flop or trigger circuit. Of even longer standing is the mechanical use 
of hysteresis in the toggle shown in Figure 6-25. The lever shown in that figure 
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FIGURE 6-25 


is unstable and is always forced from its vertical position (except at top 
dead center, where inertia is depended upon to carry it through). It must 
always lie against one of the limits. A definite amount of force is required 
to move it beyond the top dead-center position, beyond which it will drive 
itself to the other limit. This old principle is used frequently, in wall switches 
for example. The switch remembers where it was positioned last and main- 
tains that position until sufficient effort is exerted to force it to the other 
position. 

Electrical relays also have a certain inherent amount of hysteresis, 
unavoidable because of the change in the strength of the magnetic field as 
the armature position changes. In most relay applications, a certain amount 
of this is desirable so that the relay will exert sufficient contact force and will 
not be indecisive, possibly chattering, when the control voltage fluctuates 
slightly about the switching point. In such relays this effect is sometimes 
called detent action. An excessive amount of this effect, on the other hand, 
is undesirable and can introduce instability or limit cycling in the device the 
relay controls. 

Relay comparators used in analog computers also possess a certain 
amount of this detent action, as shown in Figure 6-26. In good design this 
hysteresis is kept to a minimum and usually can be neglected. When hysteresis 
is to be simulated, it can be introduced by the method described in the follow- 
ing. 

Figure 6-24c showed the simulation of a hysteresis effect by analog- 
computer means employing diodes. In summary, this produced an output- 
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FIGURE 6-26 
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input relationship, as shown in Figure 6-27. This relationship could also 
have been produced by a circuit employing comparators rather than diodes, 
as shown in Figure 6-28, The lower contactor elements (as drawn in the 
diagram) provide the hysteresis action. Once the contactor has closed (com- 
parator actuated), they reinforce its closure and require that additional. 
effort (additional change in y) be required to reverse their position again. 
(As a parenthetical note, but nevertheless useful, it may be observed that 
none of the voltages were applied directly from potentiometers to the con- 
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FIGURE 6-27 
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FIGURE 6-28 
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tactor terminals. In all cases isolating amplifiers were employed. This is done 
because the potentiometers can be adjusted, in consideration of their loading, 
only when connected to the proper output load. Had the potentiometers 
been connected directly, this would have meant assuring that each contactor 
was in the proper position to connect its potentiometer to the circuit during 
the potentiometer setting operation. To avoid this bother and easy source 
of adjustment error, it is far simpler to be somewhat wasteful of inverters 
and isolate the potentiometers in the fashion shown.) 

Simulation of such a hysteresis effect in a digital program is a relatively 
simple procedure, following directly from the logic indicated by Figure 6-28. 
Only one comparator unit of the comparator-module subroutine described 
in Section 6-3 is required for this simulation. The signal designated as e in 
Figure 6-28 is equivalent to the actuation signal, called SIG, in the sub- 
program. The comparator output, described as U in Figure 6-28, is equiva- 
lent to the actuation state, described as ACT in the subprogram. ; 

It should be noted that, since hysteresis involves a one-bit memory, 
another state has been added to the system being simulated. Hence, another 
initial condition must be given to start the program—the initial value of y 
(or the initial value of U, which provides equivalent information). This 
initial-condition information is required regardless of whether analog or 
digital simulation is being employed. 


6-10 Representation of a Three-Position Contactor 
with Hysteresis 


Figure 6-15 showed a three-position-contactor effect, the middle position 
being the inactive zone. Such an effect occurs often in control devices, not 
only with the use of electrical contactors but also with mechanical clutches 
and abruptly acting hydraulic valves. However, in most of these applications 
there will be some significant hysteresis effect. Hence Figure 6-15 is normally 
modified to appear as Figure 6-29. Again, the operation often is symmetrical 
and y(1) = —y(2), A(1) = A(2), and A(1) = A(2). 

A variety of analog-computer circuits employing diodes has been 
used to simulate this effect. One, based on Figure 6-19, is shown in Figure 
6-30. The only difference between Figures 6-19 and 6-30 is that more than 
unity-gain feedback is employed with the latter circuit so that the hysteresis 
effect desired will be achieved. From Figure 6-24 it may be deduced that the 
proper potentiometer settings will be as follows: 


2h(1) _ AQ) + AC) 
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A(2) + h (2) 


yl) 


FIGURE 6-29 


FIGURE 6-30 


In the above, & is the gain of the summer input where the feedback signal 
is applied. Obviously this gain must be greater than unity. 

Figure 6-28 has already indicated the general manner by which the 
characteristic of Figure 6-29 may be obtained by the use of comparators 
rather than diodes. The complete circuit is shown in Figure 6-31. The 
Program of that figure could be modified to reduce the number of inverters 
employed; however, it is shown there in a manner that makes the logic most 
clear. 

Figure 6-31 may also be used as the basis of a digital-simulation 
program employing two comparator units. Again, regardless of whether 
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ACI) — AQ) 


FIGURE 6-31 


analog or digital simulation is involved, the initial value of y must be stated. 
This defines the initial actuation state of both comparators. 


6-11 Multivibrator Based on the Hysteresis Effect 


In Chapter 4 it was pointed out that some source of a periodic sawtooth or 
square wave is often required, especially for driving ratchet circuits in count- 
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ing or digital-integrator applications. An example of such a circuit, employing 
relay comparators, was shown. If that circuit is examined further, it will be 
found that it is based on the principle illustrated in Figure 6-32. This two- 
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FIGURE 6-32 


step contactor with hysteresis may be constructed by employing the arrange- 
ment shown in Figure 6-22 with the following adjustments: 


pl) = —m 
y2) =m 
0) 
yi peel 


m 


The slope of the sawtooth wave generated will be +-am V/sec and the dura- 
tion of one-half period, 7/2, will be the time required for that voltage to go 
between —/ and +/ V. Hence 


Fs ah or T= Ah sec 
2 am am 


The multivibrator frequency will therefore be f = am/4h Hz. The integrator 
gain should therefore be 


One example of a multivibrator circuit employing this principle and 
using feedback limiting is shown in Figure 6-33. 
6-12 Collision Processes—Mechanical Limit Stops 


When simulating mechanical systems, the situation is often encountered 
when some moving member suddenly engages a second restricting member 
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FIGURE 6-33 


such as a limit stop. This cannot, in general, be represented by simple signal 
limiting as described in Section 6-2. Not only must the displacement limiting 
that results be considered; the force reactions that this process imposes on 
the involved members and other coupled members is also important. 

It may appear simplest to consider such a collision process as involv- 
ing the engagement of two nonresilient surfaces. Actually this is neither 
realistic nor convenient for purposes of simulation. Presumably both mem- 
bers involved will have some significant inertia; hence the sudden transfer 
of momentum assumed would correspond to infinite reaction forces being 
produced. In reality this does not occur, because of the inevitable resilience 
of the engaging members. In any event, such an assumption is difficult to 
handle with analog simulation because the infinite forces that would be 
computed at the moment of impact (actually, force impulses) would cause 
an overload. There are means for making such an assumption of zero resil- 
ience with digital simulation that will be discussed later. 

Figure 6-34 is a general schematic diagram of a translational version 
of such a collision process. It would, of course, have its rotational counter- 
part. In Figure 6-34 the driving and directly driven members are coupled 
directly together and possess the same velocity, u, = x,. The forces f indi- 
cated on the diagram are considered as positive when the members involved 
are in compression. Part of the total force f, exerted by the driving member 
will be exerted on the directly driven member and is described as /,. 

There will also exist a collision-engaged member possessing a velocity 
u, =X. When, as in (b), the surfaces are engaged, part of the force f, is 
applied as f, exerted on this member. Hence f; =f, —f,. If this collision- 
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FIGURE 6-34 


engaged member happens to be a fixed limit stop, then u, would be zero. 
Both of the engaging surfaces will possess inevitable continuously 
distributed resilience, internal friction, and inertia parameters. An exact 
analysis of the transmission of forces and velocities following collision 
involves a study of the traveling-wave phenomena involved and of the dyna- 
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mics of elasticity. In most simulation problems this local effect need not be 
simulated in detail; only its effect on the general system (of which it usually 
is only a small part) is of interest. For such purposes it usually is an adequate 
approximation to show this effect as though it were attributed only to the 
collision-engaged member, and to show it as a combination of a lumped 
resilience (described in terms of the spring constant k,) and viscous damping 
(described as B,). The distributed mass is lumped with the total mass of the 
involved elements M, and M,. 

To discuss the relative displacement of the colliding surfaces, it is 
necessary to employ some reference point P in Figure 6-34 that is used as a 
measure of the displacement of the collision-engaged member; this point 
should be located far enough from the colliding surface so that it is not 
involved to any significant extent in the resilient distortion effect near the 
the surface when engagement occurs. The distance between this point P and 
the contacting surface of the driving member is described as h. Hence the 
rate of change of / will be 


h=u,—u, (6-7) 


The distance between the reference point P and the free engaging surface 
of the collision-engaged member is described as a. By free surface is meant 
that surface location where, when there is no engagement and hence no 
compression of the effective spring k, (no contact force), a, by its definition, 
remains constant. The engagement distance, x,, is then defined as 


x,=h-a (6-8) 


This distance will be positive when there is no engagement; x, then repre- 
sents the actual spacing between surfaces. 

When engagement occurs and the compression of k, results, x, becomes 
negative. Its negative value represents the amount of compression of the 
equivalent spring k,. Hence 


—(k,x, + B,x,) when x, < 0 


(6-9) 
0 when x, > 0 


i= 
A general block diagram of the effects just described is shown in Figure 
6-35. That figure shows how the representation of the collision effect may be 
combined with other block diagrams that represent the dynamics of the 
driving element, of the directly driven members, and of the collision-engaged 
member. It is a somewhat unorthodox form of block diagram as it also 
includes the analog-computer symbol for a comparator. This is, however, 
the most effective way of describing relation (6-9) in block diagram form. 
The inclusion of the rectifier symbol in the diagram might also be noted; 
this represents the fact that the engaging surfaces can never exert tension on 
each other. 
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FIGURE 6-35 


This discussion can be clarified by some simple examples. 


EXAMPLE 1 The Bouncing-Ball Problem 

Figure 6-36 is a schematic diagram of this situation. The ball is con- 
sidered as though its contact surface were flat rather than spherical. (The 
latter consideration would result in extreme mathematical complications.) 
It is regarded as the directly driven member; hence u = —dh/dt. The col- 
lision-engaged member is the surface on which the “ball” bounces; as it is 
fixed, w, = 0. The resilience and damping effects are, of course, attributed 
partly to the ball and partly to the surfaces; however, they can be represented 
as though all of these were attributed to the surface alone, as Figure 6-36b 
indicates. The block diagram representing this situation would appear as 
shown in Figure 6-37. The arrangement of that figure is patterned after that 
of Figure 6-35. It may be noted that (because u, = 0) there is a redundant 
integration. This may be eliminated and Figure 6-37 simplified to the form 
shown in Figure 6-38. 

The accuracy of algebraic signs may be checked by noting that with 
the comparator contacts in the normally closed position (indicating that 
the ball is in contact with the surface), there is a net negative feedback through 
both the loop involving k, and that involving B,. 
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FIGURE 6-37 


The analog-computer simulation of this effect is obvious and hence 
will not be shown here. Tests on such a simulation program show that k, 
determines the amount that the ball “penetrates” the surface, i.e., how 
much the value of / will be less than the distance a. (As k, —> 00, Amin —> @-) 
B, will determine the decrement of each successive bounce; if B, were zero, 
the ball would bounce in a steady-state manner, always regaining the same 
maximum height. 
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A digital-computer program for simulating this problem appears in 
flow-diagram form in Figure 6-39. The comparator shown in Figure 6-38 is 
represented by the comparator module in that program. In addition to estab- 
lishing the surface-force reaction f, when it exists during engagement of 
the surfaces (U is false), this module also serves one other important function. 
It establishes a much smaller iteration interval At = Af,,;, during periods 
of engagement than would be required during periods of disengagement, 
when At = Af,,;,. This is necessary because of the much more rapid dynamics 
that exist when the surfaces are in contact. 

A second comparator module, which was not included in the Figure 
6-38 block diagram, is shown in Figure 6-39. This second comparator is 
actuated by the velocity u,. Hence its transition, when wu, changes sign, 
may be used to indicate instants of maximum and minimum A. Special 
printouts are called for at instants of engagement, disengagement, maximum 
h, or minimum A, in addition to the regular printouts at the normal speci- 
fied printout interval. 

A typical result of such a program is shown in Figure 6-40. Here the 
damping constant B, has been chosen so that the maximum value of x, 
(the spacing between ball and surface) decreases by roughly a factor of 2 
after each bounce. As this is a nonlinear problem, the percentage decrement 
increases somewhat with successive bounces; furthermore, the interval be- 
tween bounces decreases (as may be noted by observation of the real situa- 
tion). 
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It is useful to test such a program when B, = 0. Then there is no energy 
loss and a periodic response should result. Any increment or decrement in 
the maximum value of / between cycles is a measure of program imperfec- 
tion (insufficiently small Ar’s or inappropriate integration subroutines). 
Such a test run is similar to the sinusoidal test procedure discussed in Section 
3-12. 
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A= 1.00 INCHES MG= 1.00 LBS 
KS=1000000. LB/IN BS= 10.0 LB-SEC/IN 
DTMAX= 0.10E-O01 SECS DIMIN= 0.50E-05 SECS 

Hh H XS FS U2 

SEC IN IN LB IN/SEC 
0.0 5.00000 0.400E 01 0.0 0.0 

MAXIMUM H AT NEXT POINT 

0.0 5.00000 0.400E 01 0.0 0.00000 
0.02000 4.92280 0.392E 01 0.0 7.72001 
0.04000 4.69120 0.369E 01 0.0 15.44002 
0.06000 4.30519 0.3318 01 0.0 23.16002 
0.08000 3.76479 0.276E O1 0.0 30.88002 
0.10000 3.06999 0.207E 01 0.0 38 .60002 
0.12000 2.22079 0.122E 01 0.0 46 .32002 
0.14000 1.21719 0.217E 00 0.0 54.04002 


SURFACE ENGAGED AT NEXT POINT 


0.14396 1.00000-0.270E-07 0.556E 03 55.56967 
MINIMUM H AT NEXT POINT 
0.14404 0.99755-0.245H-02 0.245E 04 0.00004 
SURFACE DISENGAGED AT NEXT POINT 
TIME OF ENGAGEMENT WAS 0.00016066 SECONDS 
0.14412 1.00000 0.1148-08 0.0 -41.54492 
0.16000 1.61108 0.611E 00 0.0 -35.41501 
0.18000 2.24218 0.124E 01 0.0 -27.69498 
0.20000 2.71888 0.172E 01 0.0 -19.97495 
0.22000 3.04118 0.204H 01 0.0 -12.25492 
0.24000 3.20908 0.221E 01 0.0 -4.53491 
MAXIMUM H AT NEXT POINT 
0.25175 3.23572 0.224E 01 0.0 0.00000 
0.26000 3.22257 0.222E 01 0.0 3.18517 
0.28000 3.08167 0.208E 01 0.0 10.90518 
0.30000 2.78637 0.179E 01 0.0 18.62518 
0.32000 2.33666 0.134E 01 0.0 26.54518 
0.34000 1.73255 0.733E 00 0.0 34.06519 
SURFACE ENGAGED AT NEXT POINT 
0.35938  1.00000-0.445B-09 0.415E 03 41.54477 
MINIMUM H AT NEXT POINT 
0.35945 0.99817-0.183E-02 0.183E 04 0.00005 
SURFACE DISENGAGED AT NEXT POINT 
TIME OF ENGAGEMENT WAS 0.00016068 SECONDS 
0.35953 1.00000 0.125E-08 0.0 -31.04613 
0.36000 1.01444 0.144E-01 0.0 -30.86610 
0.38000 1.55456 0.555E 00 0.0 -23.14607 
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0.40000 1.94028 0.940E 00 0.0 -15.42605 
0.42000 2.17160 0.117E 01 0.0 -7.70604 
MAXIMUM H AT NEXT POINT 
0.45996 2.24852 0.125E 01 0.0 0.00000 
0.44000 2.24852 0.125E O01 0.0 0.01401 
0.46000 2.17104 0.117E 01 0.0 7.73402 
0.48000 1.93916 0.939E 00 0.0 15.45403 
0.50000 1.55288 0.553E 00 0.0 23.17403 


FIGURE 6-40 


EXAMPLE 2 Collision Engagement of a Third Member 

Figure 6-41 shows another example of a collision process where the 
block diagram of Figure 6-35 is applicable. In Figure 6-41 only horizontal 
translational motion is being considered. A time-varying displacement x, is 
imposed at point 0 of the mechanism, presumably part of the driving member. 
This portion is directly coupled with another mechanism, the directly driven 
member whose displacement is described in terms of x,. At an intermediate 
point, another collision engaged member may also be engaged by the driving 
member; the displacement of this is described as x,. All displacements are 
described with respect to a fixed reference frame and arbitrarily are zero 
when the system is in static equilibrium (all spring forces zero). The spacing 
between the engaging surfaces x, is described as x,, under such an equili- 
brium condition (when x, = x, = 0). Hence x, = x,, + x; — x2. 


FIGURE 6-41 


L6z 


FIGURE 6-42 
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Figure 6-42 shows the block diagram describing this situation. It admit- 
tedly is complicated but not complex. Nevertheless, the implementation of 
the simulation procedure is straightforward; hence neither the digital nor 
analog programs are shown here. It is especially easy to make errors in alge- 
braic sign when simulating such a system. Tracing through all the loops 
that appear in Figure 6-42 does show that negative feedback will be involved 
in each instance. This is to be expected, as the system is entirely passive; 
hence such a test is an indication that such algebraic errors probably (it is 
not a complete guarantee) have not been made. 

It should also be noted that the displacement x, is developed from the 
relation 

Xs = x, +, — *,) 

This is done in preference to developing x, by integrating x. The latter 
procedure would have involved a redundant integration. It is always pre- 
ferable to avoid this (particularly with analog computers) as any slight in- 
herent error in the integrating rates can lead to cumulative errors in some 
problems. A study of the system of Figure 6-42 would show that it is a sys- 
tem with seven states. (See Section 1-4.) One of these seven involves the 
integration relating x, to Xo, already implied in Figure 6-42. The remaining 
six correspond to the six integration operations shown in that diagram. 
As has been stated previously, no more integration operations should be 
employed in the simulation process than there are states in the system being 
represented. 


6-13 Determination of the Parameters 
of the Colliding Surfaces (k, and B,) 


In simulation problems the exact Jocal details of the collision process are not 
of interest; it is only the effect on the overall system that is of concern. 
As has been mentioned, an exact evaluation of k, and B, would be a com- 
plicated and tedious process; fortunately, this is not often required. 

It is, however, possible to determine the effective values of k, and B, 
from experimental studies of the collision process when this is feasible with 
the system being simulated. One test involves determining the coefficient of 
restitution, p1,, of the colliding surfaces. To explain this coefficient, let the 
situation shown in Figure 6-34 be considered with the external forces fo, 
fy and f, all zero; this is then described as a free-body problem. Prior to col- 
lision the mass M, is considered to-be moving at a constant velocity u,(0), 
and M, at a constant velocity u,(0). Upon collision the surfaces remain 
engaged for an interval of time ¢,. During this interval a compression force 
f, exists between the surfaces. The interval ends when f, becomes zero (cor- 
responding to the rectifier in the Figure 6-35 block diagram ceasing to con- 
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duct). Engagement then has ended (even though x, will not yet have become 
positive). Mass M, will now have a new velocity u,(t,), and M, a new velocity 
u,(t,). These will be related to the original velocities as follows: 


tat) = WO) — yp MGC + MMO) — uO] (6-10) 
s(t.) = UO) + gM + MUO) — uO] 11) 
2 


These relations define y,. Its value will always be between zero and unity; 
it is dependent only on the nature of the engaging surfaces and independent 
of the masses or velocities involved. 

The significance of the coefficient of restitution might be clarified 
further if the case is considered where M, is held stationary; this corresponds 
to u,(0) = 0, and M, — oo. Relation (6-10) then becomes 

4,(t,) = —4u,(0) (6-12) 
In other words, the mass M, would then bounce off the stationary surface 
with which it had collided and acquire a negative velocity that is a fraction, 
H,, of its original velocity. This suggests one experimental technique for deter- 
mining 4,. 

The actual mechanics of the collision process may be analyzed proceed- 
ing from Figure 6-35 and employing methods of operational calculus. This 
analysis is straightforward, but it is tedious and will not be described here. 
The results can be described in terms of ¢,, the damping ratio existing during 
the engagement interval and defined as 


(6-13) 


The coefficient of restitution can then be determined from ¢, by means of the 
following relations: 


Ciel: sont 

exp [-sthe cos” 1(2¢? - | for¢,<1 
for, e="1 
for¢,>1 


A plot of uw, versus ¢, is shown in Figure 6-43. It may be seen that 
H, = |, representing a perfectly elastic collision, corresponds to ¢, = 0, and 
hence to B, = 0. yw, = 0 represents a perfectly inelastic collision or what 
also is called a perfectly viscous collision, where €,-—» co and k, = 0. 

Relation (6-14) can be used to evaluate ¢, from experimental tests by 
which yu, has been determined. However, ¢, cannot be expressed explicitly 
in terms of y,; relation (6-14) must be employed implicitly, by graphical 
methods, or by using a digital program of the type discussed in Section 5-10. 


ms) 
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damping ratio during engagement 
FIGURE 6-43 
The spring constant k,, describing the resilience of the colliding sur- 


faces, determines the duration of the engagement interval r,. This will be 
given by the relation 


M,M,._ cos! (207 — 1) 
V@,+ Mk, JIE se 
=) py Re ine: 
t,= + Mk, for¢,=1 (6-15) 


M,M, _\n(2¢? + 26,,/07 — 1 — 1) fi 

+ MOK, Ga Oem, 

If t, has been determined experimentally and ¢, determined from a know- 
ledge of yz,, then, from relations (6-13) and (6-15), the values of k, and B, 
may be established. 


6-14 Simulation of a Perfectly Elastic Collision 


In the case of a perfectly elastic collision, B, would be zero. Hence ¢, = 0 
and the coefficient of restitution yw, is unity. The duration of engagement 


t, then is simply 
M,M. 
t, gy -16 
"\ iM, + MDE, G16) 


For the free-body-collision situation described (no external forces on the 
colliding members; hence in Figure 6-34, f, = /, =f; = 0), the engagement 
force f, is 


(ae Wig | DL FE 
ie M, + uatO) u,(0)] sin ee ayes for). <7 =f; 


(6-17) 
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and its maximum value, therefore, will be 


MM, k, : 
f= fH bus) — 10) (6-18) 


Relation (6-18) is useful in all collision situations, not simply those when 
the collision is perfectly elastic and when there are no external forces. Even 
in these other cases it is a useful approximation for determining the expected 
peak magnitude of f, when scaling analog-computer programs. 

When the situation is one of free bodies colliding, it is interesting to 
note what occurs in this situation of a perfectly elastic collision. If in relation 
(6-10) 4, is set equal to unity, there results 


wat) = FPA W100) + 5p uO) (6-19) 
M(t) = gg Hs(0) + FPP UO) (6-20) 


From this it will be found that both the momentum oe the kinetic energy 
are preserved for this perfectly elastic case. 

As an example of the result, let the case be considered where the 
overtaken mass M, initially is stationary [v,(0) = 0]. Then if the overtaking 
mass is greater (M, > M,), its velocity will be reduced but not reversed in 
direction following collision. M, will be imparted part of the forward velocity. 
This is shown in Figure 6-44a. 


displacement displacement displacement 


time time time 
(a) M,>M, (b) M,=M, (c) M; >My, 
FIGURE 6-44 


If the two masses are equal, the overtaking mass will be brought to 
a halt and the overtaken mass will acquire all its momentum. (This occurs 
in a straight short in billiards when no English is employed.) On the other 
hand, if the overtaken mass is the greater (M, > M,), u, is reversed in direc- 
tion while M, acquires a forward velocity. Simulation studies based on 
Figure 6-35 should verify these analytically derived conclusions. 

In some simulation applications it may be preferred to assume that the 
collision is perfectly elastic and that k, —> co (nonresilient surfaces), This 
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has the effect of reducing the engagement time rf, to zero and of making /, 
and f, impulses (i.e., of infinite magnitude). This can be simulated without 
overload only if the production of the signals indicating f, and f, can be 
avoided. Therefore, such an assumption is difficult to achieve exactly with 
analog simulation and usually is simply approached by making k, as high 
as scaling provisions will permit. On the other hand, the perfectly elastic 
nonresilient situation can be represented in a digital program as follows: 


1. During each iteration the portion of the program preceding the 
collision simulation will provide values of the velocities v, and w,. 

. The spacing between engaging surfaces, x,, is computed by integrat- 

ing (uy — Uy). 

3. As long as this spacing x, remains positive, no collision situation 
will have occurred and the values of u, and wu, do not require modi- 
fication. 

4. When this spacing falls to zero or becomes negative, relations 
(6-19) and (6-20) are applied to modify the velocities u, and u, to 
the values u,(t,) and w,(t,). 


i) 


Relations (6-19) and (6-20) will be applicable in such a simulation 
program even when M, and M, are not free bodies. (They may be subject 
to gravity or coupled to other elements.) This is true because the momentum 
transfer is assumed to have occurred in an infinitesimal time interval during 
which none of the finite forces involved will have had time to affect the 
velocities. 

An example of this procedure will be shown in the simulation of back- 
lash. 


6-15 Simulation of a Perfectly Inelastic Collision 


A perfectly inelastic collision corresponds to the case of zero resilience; 
the engaging surfaces exhibit only viscous damping effects, as though an 
ideal linear shock absorber were involved. Under such circumstances k, is 
zero and ¢, —> co. The coefficient of restitution 4, becomes zero. From rela- 
tions (6-10) and (6-11), 
u(t.) = us(t,) = Mata) + Hts) (6-21) 
There is no loss in momentum caused by this type of collision, but there 
naturally is a loss in kinetic energy resulting from the viscous forces. The 
two colliding bodies remain together (in the free-body situation) since they 
acquire the same velocity. 
Relation (6-21) applies to the free-body situation. Under such cir- 
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cumstances ft, would be infinite as the bodies never separate, When this 
situation exists in a non-free-body situation (i.e., when the collision occurs 
within a larger system where there are other forces applied, these other forces 
might, of course, ultimately cause separation). 

Such a perfectly inelastic collision may be simulated simply by making 
k, zero in the block diagram of Figure 6-35 and applying this to either an 
analog or digital simulation program. 

As in the instance of a perfectly elastic collision, it may be preferred 
to assume that B, approaches an infinite value. This reduces to zero the time 
required for the momentum transfer. In an analog simulation program this 
is accomplished by setting B, as high as the scaling limitations imposed on 
f,and f, will permit. In a digital program it is feasible to employ the procedure 
described in the preceding section with the one change that in step 4 of that 
procedure, relation (6-21) is employed rather than relations (6-19) and (6-20). 


6-16 Backlash 


Backlash, or free play, occurs when two coupled mechanical elements are 
not coupled rigidly but rather through an inactive zone of displacement 
within which no direct mechanical coupling exists. This effect occurs often, 
in both the rotational and translational sense, in mechanical systems. The 
most commonly observed version of this effect occurs in conjunction with 
gearing. 

Excessive backlash can cause control difficulties in mechanical sys- 
tems. On the other hand, most procedures used to reduce the amount of 
backlash can, when carried too far, result in excessive friction instead. In 
design, some type of “trade-off” is often necessary. Because of the difficul- 
ties involved in predicting the effects on the system dynamics by purely 
analytic techniques, simulation procedures are often necessary to study this 
effect. 

Simply because it is easier to show backlash diagramatically for the 
translational version, this is the form that is illustrated in Figure 6-45, 
Conclusions reached from it may, of course, be applied to the rotational 
version as well. 

Figure 6-45 is an extension of Figure 6-34. x, and x, are measures of 
the displacements of the driving and collision-engaged members. Actually, 
only their difference, x, — x,, is significant here. This governs the two 
engagement gap spacings x,, and x,,. These are given by 


X,, = x,,(0) — (x, — x,) (6-22) 
X52 = X,2(0) + (x; — x2) (6-23) 
where x,,(0) and x,,(0) are the neutral settings of the gaps (i.e., the values 
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when x, = x,). The total backlash range, therefore, is x,,(0) + x,,(0). The 
engagement force will be given by the relation 


d 
(ka + By Sf) ta when x,, <0 
4 u when x,, >Oandx,,>0 (6-24) 
+(k + B,, S)xn when x,, <0 


[Normally, x,,(0) and x,,(0) will be positive; hence the condition that x,, 
<0 and x,, <0 simultaneously will not arise.] Usually, k,, = k,2, By = 
B,,, and x, and x, may be defined so that x,,(0) = x,,(0). In that event 
the numerical subscripts need no longer be employed; they are included here 
only for the purpose of greater generality. 

From relations (6-22) to (6-24), the relationship between the force /, 
and the relative displacement x, — x, will appear as in Figure 6-46 for 
static conditions. It may be seen that an inactive-zone effect is involved. 

The block-diagram representation of this general backlash effect is 
shown in Figure 6-47. This diagram is simply an extension of Figure 6-35. 
The analog or digital implementation is straightforward, following principles 
that have already been discussed. 

Figure 6-47 represents the correct general picture of backlash. A 
number of simpler simulations have been proposed in the literature; their 
validity is based upon the validity of the simplifying assumptions upon which 
they depend. In some instances the assumption is made that the collisions 
are perfectly elastic. In that instance the collision force f, will become zero 
at the same instant that x, becomes positive, and the diodes shown in Figure 
6-47 are superfluous. Furthermore, as B,, and B,, are zero, the comparators 
function as simple diodes and may be replaced by them. Further simplifica- 
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tion is possible if, as generally is the case, k,, = k,,. Figure 6-47 then becomes 
modified to the form of Figure 6-48. When this simplification is permissible, 
one of the methods for simulating an inactive zone described in Section 
6-5 may be applied. 

Often this simplification may be carried still further by assuming that 
the colliding surfaces are nonresilient. This was discussed in Section 6-14. 
As mentioned there, this is accommodated with analog simulation by 
making k, as high as the scaling limitations imposed on f, and f, will permit. 
With digital simulation the use of a comparator module is desirable to es- 
tablish when surface engagement has occurred with either of the limit stops 
[when x, — x, equals +-x,(0)]. At such an instant of time the values of the ve- 
locities u, and wu, are modified in accordance with relations (6-19) and (6-20). 

Often the use of such a simulation program will show a repeated 
bouncing back and forth between the engaging surfaces. This is particularly 
likely to occur when the system, of which the backlash element plays a part, 
contributes insufficient damping. It is indicative of what actually will occur 
in the system rather than being an indication of a basic program error. 

In other cases of backlash, the assumption of a perfectly inelastic col- 
lision of the engaging surfaces may be more applicable. This was discussed 
in Section 6-15. In such instances Figure 6-48 is modified by deleting the k, 
block. If a nonresilient but perfectly inelastic collision is to be assumed, 
the values of B, would approach infinity. In practice, with analog simulation, 
this would mean that they would be made as high as scaling limitations 
allow. With digital simulation a comparator module again would normally 
be used. Relation (6-21) would now be employed to establish the new values 
of u, and u, after engagement had occurred. 


inactive zone 


FIGURE 6-48 
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There will be a number of instances when this assumption of a non- 
resilient but perfectly inelastic collision may be assumed in connection with 
backlash phenomena. There will be far fewer instances when it can also be 
assumed that the driven mass M, is negligible and that it is coupled to mem- 
bers that also have negligible inertia. When this is the case, the situation de- 
scribing the effect of backlash reduces to the very simple one on which 
Problem 4-4 was based. Unfortunately, this very special case has been pre- 
sented by a number of writers as describing the general picture of backlash. 
A. C. Jackson [1] has aptly named this special case “pseudobacklash” to 
warn the reader that its validity is greatly limited. 


6-17 Friction 


The term friction has many varied connotations. Some forms of friction 
give rise to forces or moments that are continuous functions of the velocity. 
These functions may have various forms; for example, friction caused by 
energy losses in a fluid, as with fans or propellers, may often be represented, 
at least approximately, by the absquare function (i.¢., f, = kulu|, or m, = 
kq@|q@|) or by more complicated relationships if the more exact fluid dy- 
namics are to be taken into account. Such relationships may be handled 
readily by diode function generators when analog simulation is being 
employed, or by appropriate analytic approximations or tabulated data 
when digital techniques are being used. 

As in the example treated in Chapter 1, some forms of friction may 
be approximated as linear or viscous (i.e., f, = Bu or m, = Ba). This form 
is, dr)course, the simplest to represent in a simulation program. Such linear 
friction arises with fluid-type dampers such as dashpots provided only 
viscous fluid-flow conditions exist (a less-than-critical Reynolds number). 
However, it should be noted that many damping elements purported to be 
linear may often operate in the turbulent-flow region where the absquare 
relationship is more appropriate. Hydraulic shock absorbers may or may 
not be linear; often they include devices such as check valves so that the 
force relationship is different for positive and negative velocities. Some types 
of electrical dampers, such as eddy-current brakes, present essentially linear- 
friction characteristics over limited ranges of velocity. 

Two very common discontinuous types of friction occurring when 
mechanical surfaces are in direct contact (e.g., not separated by a viscous 
film of lubricant) are Coloumb friction and stiction. The former, also called 
dry friction, is very simple to represent, being given by the following relation- 
ship for the translational case: 


J, = F.sgnu (6-25) 


9 
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or, for the rotational case, 
m, = M, sgn @ (6-26) 
where sgn is simply the algebraic sign function; e.g., 
+1 foru>0 
sgn u = 40 foru=0 
—1 foru <0 


Relations (6-24) and (6-25) may appear to be similar to that of the two- 
position contactor shown in Figure 6-12. Actually, there is a significant 
difference because that contactor relationship allows for only two values of 
the function while, on the other hand, the Coloumb-friction force will fall 
to zero when there is exactly zero volocity. Hence, with analog simulation, 
circuits as shown in Figure 6-13 should be employed (where there is no true 
discontinuity at zero) rather than relay comparators. 

In many instances the type of friction occurring will be a combination 
of a number of the types discussed here. It is especially true that when 
Coulomb friction exists, stiction will exist as well. Therefore, these two types 
should be simulated specifically as a combination. This is discussed in the 
section to follow. 

In any event, it should be pointed out that friction, in general, is a 
very variable effect. Different mechanical elements off the same production 
line may exhibit markedly different characteristics, and the same element 
may itself at different times exhibit markedly different characteristics, depen- 
dent upon such factors as past wear and tear, state of lubrication, and 
operating temperature. Hence any simulation of a friction effect is neces- 
sarily approximate, based upon “typical” values. 


6-18 Stiction 


As just stated, stiction as well as Coulomb friction occurs whenever two 
surfaces are in sliding contact. It is easier to describe the effects of stiction 
in verbal rather than strictly mathematical form. 


1. Whenever the velocity is zero, the stiction effect will come into play. 
The application of any force or torque to the member involved 
will result in the development of a stiction force or torque of exactly 
equal magnitude and opposing direction, so that the velocity will 
continue to be zero. 

2. When the applied force (torque) reaches a critical value, F, or M,, 
the stiction limit, then this opposing stiction force (torque) will 
disappear suddenly, corresponding to breakaway, and an immediate 
acceleration of the member results. 
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3. Once motion does occur following breakaway, the Coulomb or 
sliding-friction effect described previously will apply (i.¢., f, = +E, 


or m, = -+M.,). Stiction will not reoccur until the velocity falls again 
to zero, 


Figure 6-49 is a block diagram for representing the combination of 
stiction and friction. f, is the force applied to the mass and /, is the total 
force reaction caused by the mass velocity and/or displacement. The two 
stiction comparators function on the basis of the logic described above. 
The comparator having the w (velocity) input is deactuated whenever the 
absolute value of u, or |u|, is zero; in practice, with either digital or analog 
computation, this must be interpreted as |u| being less than some small but 
finite tolerance range or threshold, u,. The second comparator associated 
with stiction is actuated only when the absolute value of the force f that is 
applied exceeds the stiction value F,. If either comparator is actuated, the 
forces are transmitted to the mass. 

The friction comparator operates on the basis of the algebraic sign of 
u, applying the appropriate friction force --F, whenever a velocity exists. 
However, when |u| < u,, no friction force is assumed to be applied, hence 
the connection to the additional contacts actuated by the u comparator. 

Figure 6-50 shows an analog-computer program based on this logic. By 
means of diodes, the OR feature of the two stiction comparators shown is 
combined so that only one comparator is needed for this function. An 
additional practical feature is added; because of the velocity threshold u, 
that must be employed, the integrator will not ordinarily have exactly zero 
output when stiction takes over. This would mean a small, fallacious drift 
in displacement (the integral of u). To avoid this the integrator is clamped 
(i.e., the capacitor C is effectively short-circuited under this condition). 
Actually, the shorting is accomplished through some finite but small resis- 
tance R, selected so that the current that flows through the relay contacts 
will not be excessive. With the digital simulation program to be discussed 
next, a similar clamping action is necessary. This will be done by setting the 
velocity u to exactly zero whenever stiction takes over. 

Figure 6-51 shows how a general simulation program might be modi- 
fied to account for a combination of stiction-friction effect. Two comparator 
modules, numbered by the integers COMP, and COMP,, must be reserved for 
this purpose. The signal actuating COMP, is simply the velocity w; that actuat- 
ing COMP, is | f| — F,, determining whether stiction may be overcome by 
the available force. The initialization procedure necessary is shown in Figure 
6-51. The simulation program then proceeds as in Figure 6-8, just up to the 
point where the integrator inputs are to be established. At this point, the 
stiction-friction subprogram to be described below is called. The program 
then returns to the normal pattern of Figure 6-8. 
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Figure 6-52 is a flow diagram of the stiction-friction subprogram. 
During the first iteration (START = true) the initial stiction state (whether 
stiction has broken away or is holding) is established. Thereafter, the pro- 
gram follows one of two alternative courses. 


1. If STICTION originally was false (i.e., stiction has already been 
broken away), a change in condition is considered only when the 
COMP, comparator has changed state, indicating a condition of zero 
velocity. Then, if and only if the COMP, comparator is not actuated 
(| f | does not exceed F,), will stiction be assumed to start to hold. 
The logical variables involved are modified accordingly. 

2. If STICTION originally was true (i.e., stiction had been holding), 
a change in condition is considered only when the COMP, com- 
parator becomes actuated, meaning that the force available has 
finally exceeded the stiction limit F,. The logical variables involved 
are then modified accordingly. 


Under the conditions when stiction is not in effect (STICTION is 
false) the acceleration of the associated mass is determined in the last step 
of the subprogram. Here Coulomb friction F, is taken into account; the sign 
by which it enters into the relationship is determined by the algebraic sense 
of the velocity u (i.e., by the actuation state of the comparator labeled COMP,). 

Figure 6-53 illustrates a simple mechanical situation involving static 
friction. Here the displacement x of the free end of a spring k is given as some 
function of time. The resulting displacement y of the mass m is of interest. 


FIGURE 6-53 stiction-friction 


Figure 6-54 is a flow diagram of a simulation program to represent this 
situation, following the general pattern of Figure 6-51. 

Figure 6-55 shows a typical response when x is a triangular function 
of time (i.e., a ramp function followed by a later reversal in direction of 
motion). The alternate holding and releasing action of the stiction effect may 
readily be seen and conforms with the situation that is actually observed 
physically. 

Another representation of stiction-friction sometimes used with 
analog simulation when comparators are not available consists of generat- 
ing the function shown in Figure 6-56 by means of diode function generators. 
In that diagram, €, and €, are maintained as small as the slope limitations 
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STICTION-FRICTION example of Figure 6-53 
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of the function generators will permit. This representation of the stiction— 
friction effect is adequate for some simulation problems. Its major disadvan- 
tage is that it will permit some small but finite indication of velocity while 
stiction is in effect. 


Suggested Problems 


6-1. A servomechanism system is used to position the angle 8, of an output 
load to some desired value @,. This system employs the speed-control system 
of Problem 1-3 and is represented by Figure P6-1. The servomechanism’s 
closed loop is completed by adding, to the arrangement of Problem 1-3, 
an angle-error detector that senses the actual load angle 8,, compares it 
with the desired angle 0,, and establishes the angle error 0, 4 0, — @,. 
(Various types of mechanisms, e.g., synchros, might be used for this purpose.) 
In any event, the associated control preamplifier produces a signal: 
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HO, volts for —e, < WO, <e, 
@ =e, volts for “0, > e, 
—e,volts for “0, < —e, 


In other words, there is hard limiting imposed on what otherwise would 

have been a linear control relationship. The limit e, is 200 V. 

(a) Simulate this system by analog means, supplementing the program 
developed to handle Problem 1-3. Then investigate the relationship 
between the gain yw and the stability of the system when step changes 
of 6, are applied. 

(b) Repeat, employing a digital program. 

6-2. In the servomechanism described for Problem 6-1, a two-position 

contactor is substituted for the continuous controller. That is 


ey when 0, > 0 
e= 
° |-e, when 0,<0 
where, again, e, = 200 V. 
Using both analog and digital programs, investigate the performance 
of this system. 


6-3. Again, for the servomechanism described for Problem 6-1 a contactor 
control is substituted. However, in this case 
ey when 0, > 04 
& = 40 when —0, < 0, < 4 
—e,  whend,< —6, 
where e, again is 200 V, and where 6, is an adjustable inactive zone, mea- 
sured in radians of angle. Use both an analog and a digital program to 


determine the effect of the adjustment of @, on the response of this system 
to step-function changes in 8,. 


6-4. This is an extension of the previous problem. In reality the contactor 
operation described is being established by an electromechanical relay sys- 
tem that has 20 per cent hysteresis. That is, the relationship between e, and 
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FIGURE P6-4 


0, is as plotted in Figure P6-4. Again, e, = 200 V. Repeat the work of Pro- 
blem 6-3 for this new condition. 


6-5, This refers back to Problem 6-1 (linear control with hard limiting), 
except that the position of the output angle @, is restrained from motion 
beyond +1.0 rad by hard limit stops, approximately represented as being 
perfectly elastic but of zero resilience (B, = 0,k, — 00). The range of 0, 
is limited to within +1.0 rad. Investigate the response when 0, is changed 
in step fashion from —0.9 to +0.9 rad for various values of the gain yw. 
Simulate with both analog and digital programs. 


6-6. This problem is the same as Problem 6-5 except that now the limit 
stops are assumed to be perfectly inelastic but with zero resilience (k, = 
0, B, — 00). 


6-7. Refer to Problem 6-1. Both backlash and resilience effects exist in the 
gearing coupling the motor and load. Both of these effects are, of course, 
distributed through the various stages of the gearing, but can be represented 
as lumped equivalents, an effective torsional spring of constant k, = 1.6 
x 107 kg-cm/rad as referred to the output shaft, and by a backlash range 
of 0.001 rad, also as referred to the output shaft. Repeat Problem 6-1 
with these effects added. 


6-8. This is a repetition of Problem 6-7 except that there also exists a stic- 
tion-friction load given by 

M, = 15,000 kg-cm 

M,= 5,000 kg-cm 
Determine what effect this has on the servomechanism system. 
6-9. Establish by analytic methods (not experimental) the y versus x rela- 
tionship that will result for the analog computer program shown in Figure 
P6-9. 
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6-10. The simulation of the vertical motion of a four-wheeled vehicle 
traveling over a rough road is a somewhat complicated but practical problem. 
A less complicated version does provide some insight into this, and involves 
a theoretical “one-wheeled” vehicle. This is represented by Figure P6-10a. 
y, is the equivalent vertical displacement of the road in feet, with a correc- 
tion made for the tire radius. y, and y, are the vertical displacements in feet 
of the vehicle and wheel, respectively, and considered to be zero when in 
static equilibrium (with gravity force) with y, zero. 

The horizontal travel of this vehicle is measured in terms of x in feet. 
The vehicle is traveling at V ft/sec and hits the curbing shown in Figure 
P6-10b. y, represents the actual road profile. However, since the tire is 
assumed to have a mean radius of 1.1 ft, the equivalent road displacement 
y, appears as in Figure P6-10c, where 


M,, is mass of vehicle, M,g = 3000 Ib 

k, is spring suspension rate, k, 
= 6000 lb/ft 

B, is shock-absorber damping constant, 
B, = 1500 Ib/(ft/sec) 

M,, is mass of wheels, M,,g = 100 Ib 

k,, is spring rate of tires, k, 


= 50,000 lb/ft 
B,, is damping constant caused by tire 
friction, B,, = 800 Ib/(ft/sec) 


FIGURE P6-10a 
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Vy» ft 
0.5 
x, ft 
10 12 
FIGURE P6-10b 
FIGURE P6-10c 
0 for x > 9.078 
V/1.21 — (10 — x)? — 0.6 — for 9.078 <x < 10 
y, = 40.5 for) 10's 12 


1.21 — (x — 12)? — 0.6 for 12<x < 12.922 
for > 12,922 


Simulate this situation for various horizontal velocities V ranging 
from 5 to 100 ft/sec. Keep in mind that the road surface cannot exert tension 
on the tires, pulling them downward. 


6-11. Consider Problem 6-10 again but with limit stops added to the sus- 
pension system so that | y, — y,| may not exceed 0.5 ft. Assume a perfectly 
elastic collision with negligible resilience (B, = 0, k, —+ 0). 


6-12. As illustrated in Figure P6-12, a member A of mass M rests inside 
another member B that has a relative displacement x. The only forces on A 
are gravity and the engagement force of B on either the upper or lower sur- 
face of A. The vertical displacement of A is described as y, equal to zero 
when A is resting on the lower surface and x is zero. There is a vertical 
clearance space of 0.1 in. between A and B. B moves with a vertical sinu- 
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FIGURE P6-12 


soidal motion of 0.5 in. amplitude, or 
x = 0.5 sin 2xft inches 


where f may be any frequency between 0.1 to 100 Hz. B has sufficient mass 
so that its motion is assumed unaffected by the motion of A. 

It is assumed that the engaging surfaces have zero resilience; i.e., the 
transfer of momentum is approximated as instantaneous. The coefficient of 
restitution will have different values between zero and unity. Simulate this 
situation on both analog and digital computers and determine the steady- 
state response of y to this sinusoidal variation of x for various frequencies 
f and values of coefficient of restitution equal to 0.0, 0.25, 0.5, 0.75, and 
1.0 
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Boundary-Value Problems 7 


7-1 Occasions When Boundary-Value Problems 
Arise 


In many situations to be simulated, specific conditions are to be met at 
specific values of the basic independent variable and either the initial condi- 
tions or the value of one or more parameters is to be determined so that these 
conditions will be met. Problems in simulation described by this general 
statement are called boundary-value problems. [1,2] This definition might 
be clarified by specific examples. 


1. The problem of static bending of a simple beam, where the basic 
independent variable is distance along the beam, x (rather than 
time, f, as in dynamic problems). As will be explained in this chapter, 
this will be describable by a fourth-order differential equation. To 
simulate this by conventional methods, four initial conditions must 
be established: the deflection at x = 0, the slope at x = 0, the 
shear force at x = 0, and the bending moment at x = 0. Normally, 
not all these four initial conditions would be known in such a prob- 
lem. Instead, for example, deflections, slopes, moments, or shear 
forces might be specified at some other points along the beam; this 
is dependent on the manner in which the beam is supported. The 
unspecified initial conditions must be established so that they will 
satisfy the other specified boundary conditions. In simple beam 
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problems this can be handled analytically, but in more complicated 
situations trial-and-error solutions are required. Such solutions can 
be performed most expeditiously by negative-feedback techniques 
using either analog or digital computers. In summary, this particular 
example represents a case where it is some of the initial conditions 
that are not known. 

2. The problem of determining the actual interest rate applicable when 
a loan is paid according to an established schedule, where the 
noninitial boundary condition is the fact that the principle will 
become zero at the termination date of the loan. The unknown 
quantity is the interest rate, a parameter. Here again, a solution is 
effected most expeditiously by trial-and-error methods. 

3. The problem of determining optimum parameters of a control 
system so that a certain objective will be attained at a specified 
instant of time. Such a system might, for example, be responsible 
for moving an object in space from one point to another so that, 
at the specified instant of time, the object will have arrived at exactly 
that point with zero velocity and acceleration; these latter conditions 
are the boundary values. Here again, the problem is one of deter- 
mining the values of the parameters necessary so that these bound- 
ary conditions will be satisfied. (When this problem is extended 
to one of determining the parameters for making the time of attain- 
ing these conditions a minimum, the problem then becomes an 
optimization problem, the subject of Chapter 8.) 

4. Distributed parameter problems such as those involving trans- 
mission lines, heat flow, and distributed mass and resilience systems, 
will involve boundary conditions to be satisfied at various points. 
This is covered in more detail in Chapter 10. 


The general approach to be employed when handling such boundary- 
value problems is illustrated best by example, using 1, 2, and 3 as illustra- 
tions. 


7-2 General Example of Static Bending 
of a Simple Beam 


The horizontal beam considered will be assumed to be subjected to only 
vertical forces and associated moments. These forces and moments may be 
divided into two categories: 


1. Concentrated forces and/or moments at a point (this is, of course, 
an approximation of the real situation). 
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2. Distributed forces. 


Because of the assunption of point forces, the axial points, x,, at which 
these forces will be applied will be of special interest. These points can be 
classified among the five types shown in Figure 7-1. 

The distributed loading, described as w(x), is such that on any given 
span, say from x, to x,, the load would be 


Type 1. Simple force-application point 


% the deflection Fe 


is not specified; 
it must be deter- 
mined 


y, 
ee | id y ref. 
e f the deflection 
yt is speci- 
fied; the force 
F,, must be es- 
tablished 


*p 


Type 4. Support from both above and below, 
or pin support 


i y ref, 
x, { 
L- | 


Type 5S. Cantilever support, constraining 


both deflection, y_, and slope, the deflection y 


P and the slope 
(dy/dx), an (dylds), are 
ly /dx)p 


specified; both 
force F,, and 
moment M,, must 
be established 


FIGURE 7-1 


324 Boundary-Value Problems Chap. 7 


f w(x) dx 


w(x) may be various functions of x, as shown in Figure 7-2. (Such loading 
generally is downward, and hence would appear as shown.) w(x) would, of 
course, include the effects of the beam’s own weight. The point forces, 
considered previously, could be considered as impulse functions super- 
imposed on w(x). 


w(x) 


FIGURE 7-2 


If, as rarely is the case, the only force-application points are of Type 1, 
the analysis problem then becomes straightforward. The axial distance x is 
measured from the left-hand end. Vertical beam deflections y are measured 
from some reference level with upward deflections being considered as 
positive. Such deflections are measured to the neutral axis of the beam; this 
roughly is the center of the cross-sectional area, although more rigorous 
definitions are required for complicated and nonsymmetrical cross-sectional 
shapes. The analysis steps would be as follows. 


1. The shear force along the beam is established by the relation 
S(x) = f “woods + DAO (7-1) 


where m is the number of force-application points between x = 0 
and x = d and F,(t) is the force applied at the ith point. 
2. The bending moment along the beam is established by the relation 


M(x) = f * s(x) dx + Ss Mi) (7-2) 


where j is the number of moment-application points between zero 
and d. 

3. Simple bending is assumed where the radius of curvature will be 
EI/M. (The effect of the shear on deflection is usually relatively 
negligible and will be neglected here.) For practical beams where 
the change in slope will be small, the radius of curvature is essen- 
tially 1/(d*y/dx*); hence 
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dy _ M(x) 
dx? EI(x) 
where E is the coefficient of elasticity of the material and J is the 
beam cross-sectional area moment of inertia about the neutral axis. 


For the case of varying cross sections, EJ will be a function of x. 
4. The slope dy/dx is then computed as 


(7-3) 


= | S2dx (7-4) 
5. The deflection itself is simply 


vd 
y=f @ dx (7-5) 


Four integration operations, therefore, are necessary; the variable of 
integration (the basic independent variable) of the simulation process, there- 
fore, is x rather than time, as in the examples considered previously. 

The above operations are straightforward and are handled readily by 
analog or digital computers. With analog computers x is scaled to machine 
time ¢,,; with digital computers any of the integration methods mentioned 
in Chapter 3 may be used. (Other integration methods could also be employed 
as the future values of the integrands will be known in advance, in contrast 
to problems in dynamics.) 

No boundary-value problems arise with this simple example. The 
necessary boundary conditions at the right-hand end of the beam where x = 
dare 


S(d)=0 (7-6) 
M(d)=0 (7-7) 


These will, however, be met automatically if the sum of the forces and of the 
moments applied to the beam each total zero, as. they would have to if static 
equilibrium were to apply. 

In more typical cases, however, boundary-value problems do arise. 
Normally, not all the force-application points are of Type | but consist rather 
of various types of supports, Types 2 to 5. These will apply forces that 
initially are unknown; for a Type 5 support an unknown moment will be 
applied as well. The supports will specify the deflections y existing at the 
support points and, for a Type 5 cantilever support, will specify the slope 
dy/dx as well. These specified deflections and moments are, in addition to 
the conditions of relations (7-6) and (7-7), the boundary conditions to be met. 
The forces imposed by each support and the moment imposed by a Type 5 
support will, in addition, represent the boundary inputs to be established 
so that the boundary conditions will be met. Furthermore, if the first force- 
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application point, always designated as point 1, at x = 0, should be of Type 
1, the initial values of both deflection y(0) and slope (0)! will be boundary 
inputs, to be established. If this point is of Type 2, 3, or 4, on the other hand, 
only the initial slope will be a boundary input. In any event, there will always 
turn out to be exactly the same number of boundary conditions and inputs. 

For ease of describing this further, the specified boundary conditions 
to be met will be given the symbol B,,,.. The actual boundary values, observed 
during the trial-and-error process of adjusting the boundary inputs, will be 
called B,,,. The boundary inputs to be established will be called B,,. When 
the proper values of B,, have been established, the values of B,,,, and Boy, 
will be equal. 

To describe the operations to be performed, consider the force-appli- 
cation points to be numbered sequentially (in order of increasing x) from 1 
to N. The point x = 0 will always be called point | [if no force is applied there, 
F,(1) will simply be zero]. Similarly, the point x = d will always be called 
point N [again, if no force is applied, F,(N) = 0]. The ith point has associated 
with it forces designated as F,(i), possibly (for Type 5 supports) moments 
designated as M,(i), deflections designated as y,(i), and slopes designated 
as (dy/dx),(i). The general sequence of operations then is as follows: 


1, Consider point 1 (x = 0). 
(a) If this point is of Type 1, then 
B,.(1) = y,(1) 
Bu) = ($2) 
The known initial conditions are 
S(0) =0 
M(0) =0 
(b) If this point is of Type 2, 3, or 4, then 
Bull) = (#) o 
B,.(2) = F,(1) 
The known initial conditions are 
yO) = y,(1) 
M(0) =0 
(c) If this point is of Type 5, a cantilever support, then 
B,(1) = F,(1) 


1Dot notation will be used here to signify derivatives with respect to x rather than to 
time 1. 
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B,.(2) = M,(1) 
The known initial conditions are 
»0) = y,(1) 


30) = (#2) 


2. Now all other force-application points from i= 2 to N— 1 are 
considered in turn. 

(a) If point i is of Type 1, then the value of F,(i) is simply added 
to the value of shear force in accordance with relation (7-1) when 
that point is reached. No new boundary conditions or inputs 
are involved. 

(b) If the point is of Type 2,3, or 4, then the deflection of this 
point has been specified and 

Bork) = yx,(i)] 

Bipeclk) = y,(i) 
[The observed boundary conditions and specifications will be 
subscripted (k) in the order in which they appear.] The presently 
unknown boundary input, to be established, is 

BG) = F,() 

[Similarly, boundary inputs will be subscripted (j) in the order 
in which they appear. The boundary inputs for j = 1 and j = 2 
were already established at point 1.] The trial value of F,(i) is 
added to the shear force at this point. 


(c) If the point is of Type 5, then both the deflection and slope 
at this point have been specified and 


Bovs(k) = lx, (i)] Bryec(k) = Y,(i) 
. P F d F 
Bows(k + 1) = yx, (i Breclk + i) = (22) 
mE +N =O] Balk +) = (B) 
The previously unknown boundary inputs, to be established, 
are 
Bi(j) = F,(i) 
B,(j + 1) = M,(i) 
3. Finally, at the end of the beam the following conditions are imposed: 


(a) If this end point is of Type 1, then the boundary conditions to 
be met are 


Bovs(k) = S(d) Brpec(k) = 0 
Bok +1) = Md) Bylk + 1) =0 
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Prior to computing S(d), the value of F,(N) is added to the 
accumulated value of shear force. 

(b) If the end point is of Type 2, 3, or 4, the boundary conditions 
to be met are 

Bovs(k) = ¥(d) Byyoclk) = y(N) 
Book + 1) = M(d) Byyeclk + 1) = 0 

The values of F,(N) must equal the value of shear stress accu- 
mulated up to this point since the shear at the very end of the 
beam must be zero. 

(c) If the end point is of Type 5, then the boundary conditions are 
described by 


Boulk) = yd) Baek) = ¥4(N) 
Boul +1) =H) Bryctk + 1) = (#2) W) 


Both the shear and the moment at the very end of the beam 
must be zero. Hence F,(N) must be equal to minus the value 
of S accumulated up to that point, and M,(N) must be minus 
the value of M so accumulated. 


The difference between force-application points Types 2,3, and 4 
has still to be considered. It is obvious that Type 2 supports can exert only 
negative forces and Type 3 only positive forces. 


7-3 Specific Example of a Simple Beam 
with Cantilever Support at x = 0 and One 
Other Support Point 


For the beam shown in Figure 7-3, the block diagram of the simulation model 
would appear as in Figure 7-4. Note that three boundary conditions are 
specified: 
Byrec(1) = y,(2) position of center support 
Byyec(2) = 0 as S(d) = 0 
Byoec(3) = 0 as M(d) = 0 
The actual observed boundary conditions resulting from the model are 
Boys(1) = ix, (2)] indicated position of beam at center support 
Boy(2) = S(d) 
By s(3) = M(d) 
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—w(x) 
Type Type | 
a with Mp (1) 
f= 0 
FQ) F,(2) 


FIGURE 7-3 


The error in boundary conditions is, in general, 
Berrold) = Byyeci) — Bovs(i) 


Some process is required for automatically adjusting the boundary inputs 
until the error is made zero. These boundary inputs are 


B,(1) = F,(1) 
B,.(2) = M,(1) 
8,3) = F,(2) 


Note that there are as many boundary inputs as there are conditions to be 
adjusted. 

Normally, with the center support in contact, there are three boundary 
inputs with this example and three boundary errors to be made zero. How- 
ever, for the Type 3 support being considered, the force F,(2) can never be 
negative. This fact is shown in Figure 7-4 by the comparator having B,,(3) 
= F,(2) as an input. If F,(2) < 0, this force is held at zero instead. Further- 
more, one boundary-error signal, designated as B,,,,;(1) = Yx,(2)) — y,(2), 
no longer applies. 

The relationship between the required correction of the boundary 
inputs, designated as AB,,, and the boundary errors represents a set of simul- 
taneous algebraic equations. That is, these relationships may be represented 
by the matrix relation 


(ABss] = [A] [Berror] (7-8) 


In the above example this A matrix is of dimension 3 x 3 until the center 
support loses contact with the beam; it then becomes 2 x 2. 
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7-4 Analog Approach Toward Boundary-Input 
Adjustment 


A repeated trial simulation of the beam model is easy to accomplish when 
dynamic-storage methods are available in an analog computer. For the 
example of Section 7-3, the block diagram of Figure 7-4 directly suggests 
the configuration. The repeated trial-and-error simulation of the beam would 
be performed in the high-speed-repetitive mode; the correction of boundary 
inputs, in the normal time mode. The more difficult problem is the handling 
of the boundary-input corrections. 

The obvious analysis method to be used would be based upon the 
implicit methods discussed in Chapter 5. The existence of boundary errors 
would result in rates of change of the boundary inputs until all errors were 
zero. The question arises, however, which error should cause a rate of change 
of which boundary input, and in what direction? The answer is not neces- 
sarily obvious from physical considerations. 

One relatively crude approach would be to use a series of console 
switches to make this decision. For the example of Section 7-3 with the analog 
arrangement of Figure 7-4, the procedure might be as shown in Figure 7-5. 
By this arrangement, a trial-and-error selection of the best feedback arrange- 
ment, including the relative gains of the three correction channels (set by 
the three potentiometers), can be established. Note that there is no choice 


<i 
B,,(3) “| (?5) Berror(1) 


Besror (2) 


Berror (3) 


sign selec- signal selec- 
tion switches tion switches 


FIGURE 7-5 
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with regard to the establishment of B,,(3); it must be established by B,,,o,(1) 
because, when the central support no longer engages the beam, both signals 
disappear. 

It will be found that unless a correct selection is made the correction 
process will be unstable. To obtain a reasonably fast, stable, and well-damped 
correction, it will be necessary to adjust the relative gains rather carefully. 
The correction problem here is an example of the general feedback-control 
problem involving multiple inputs and multiple outputs; a correct choice of 
“what controls what, and how much” must be made if instability or poor 
response is to be avoided. 

A far better correction of boundary inputs could be established if all 
errors affected all inputs, using the analog scheme shown in Figure 7-6, 
where the operations described can be represented in matrix form by the 
relation 


Bin(3) B 


error (1) 


to change sign where necessary 


Inverters in some channels, 


Biy(2) <i i Berox(3) 


FIGURE 7-6 
B,,(1) Qj Ayr 445] | Berror(1) 
at By(2)|= k\ az, 422 23) | Berros(2) (7-9) 
B;,(3) L435, 32 433} | Bereor(3)_ 


or, more generally and more compactly, by 
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d 
GF Biel = MAM Berros] (7-10) 


In Figure 7-6, the potentiometer settings in connection with the integrator 
gains establish the constant k and the elements a,, of the A matrix. (Diagrams 
of the type shown in Figure 7-6 become cumbersome if there are a large 
number of boundary conditions and boundary inputs to be considered. 
Under such circumstances the use of block diagrams is generally avoided and 
the matrix description is alone employed to describe the interconnections.) 

It can be established by feedback-control theory that the most effec- 
tive correction of the boundary errors will be obtained when the A matrix 
is determined by the following procedure: 


1. The effect of changes in the boundary inputs AB,, upon changes 
in the boundary errors AB,,,., are established by perturbation tests 
(i.e., by making such changes in each input, one at a time, and 
observing the effect upon the error). This will lead to a set of rela- 
tions that can be expressed in matrix form as 


[ABeeror] = [C]AB;n] (7-11) 


where C will be a square matrix with each dimension equal to the 
number of boundary conditions involved. 

2. The optimum A matrix, referring to relation (7-10), then is the 
inverse of the C matrix. When only analog equipment is available, 
this inversion procedure may have to be performed by pencil-and- 
paper methods. (There are analog techniques of matrix inversion 
available but rather elaborate programming is required.) Such a 
method of matrix inversion could prove extremely tedious when 
the number of boundary conditions is high; for the specific example 
shown in Figure 7-3, however, the labor involved is not excessive. 
Once the inverse, A, matrix has been established, each potentiom- 
eter shown in Figure 7-6 is then set so that, for example, 


Pi = k|ay| (7-12) 
Whether or not an inverter is required depends upon the sign of 


a,,. As the integrators already provide a sign inversion, an inverter 
is required only when a,, is positive. 


The result of this technique is a noninteracting feedback system. That is, 
a given boundary error B,,,.(j) will give rise to corrections of boundary 
inputs that are so proportioned that there will be no effect on the other 
boundary errors being corrected separately. Stability problems then no longer 
arise; the adjustment of the boundary conditions will occur according to 
an exponential time relationship and, as k is increased within reasonable 
limits (because the data sampling effect of the high-speed-repetitive operation 


334 Boundary-Value Problems Chap. 7 


could cause other stability problems if k were too high), the rate of boundary- 
input correction will become increasingly rapid. 

Figure 7-4 shows that the boundary input B;,(3) = F,(2) is removed 
when the support at point 2 loses contact with the beam [i.e., when F,(2) 
tries to become negative]. The boundary error designated as B,,,.,(1) then is 
no longer considered. The matrix acquires a smaller dimension, 2 x 2, and 
the four elements of the A, inverse, matrix are then computed differently. 
Referring now to Figure 7-6, when B,,(3) and B,,,..(1) are removed, the 
only significant potentiometers are P,,, P,;, P22, and P,,. However, their 
optimum settings for such a noninteracting-control type of convergence will 
now change radically and will be based, by relation (7-12), on the new smaller 
A matrix. 

This particular example shows the advantage of hybrid analog-digital 
simulation. The many repeated trial integrations over the span of the beam 
are performed most expeditiously, and certainly most rapidly, by analog 
means. The matrix inversion necessary to obtain the optimum boundary- 
condition corrections is, on the other hand, performed much more readily 
by digital computers. Furthermore, the various logical operations necessary 
to establish the effect of a Type 2 or Type 3 support losing contact with the 
beam is handled most easily by digital logic. Such a hybrid simulation could 
produce an almost instantaneous display of the changing conditions along 
the beam as various factors, such as loading and the position of supports, 
were varied. 

A discussion of the techniques necessary to establish such a hybrid 
simulation must be deferred until a later chapter. Next to be discussed is 
the purely digital approach for simulating not only the specific situation 
represented by Figure 7-3 but also the general problem of beam bending. 


7-5 Digital Simulation of Beam Bending 


Digital simulation of beam bending is quite straightforward and can make 
effective use of the subroutine modules INTEGRATE, SIMULTANEOUS, 
SIMQ, COMPAR, and SETDT mentioned in previous chapters. Any of the 
integration modules discussed in Chapter 3 that do not involve extrapo- 
lation (the extrapolating type b modules are unsuitable because of the dis- 
continuities that occur at the special force-application points) may be used 
for integrating along the length of the beam in accordance with relations 
(7-1), (7-2), (7-4), and (7-5). Of course, the variable of integration now is, 
the distance x rather than time 1. 

The integration problem actually is somewhat different and also simpler 
than those involved in the dynamic problems discussed in the preceding 
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chapters. Here the future (meaning higher values of x) values of the integrand 
are known in advance and do not depend on what the integral turns out to 
be. There are other methods of integration (e.g., Simpson’s rule) that can 
be employed effectively under such circumstances. However, all of the non- 
extrapolating methods mentioned in Chapter 3 will be suitable, although 
they may require longer execution times (for a specified degree of accuracy) 
than these other methods. 

With the analog simulation of this general problem, analog com- 
parators were used to locate the force-application points. Similarly, the 
COMPAR module may be used for this same purpose. It is true that the use 
of this module will increase execution time somewhat, because of the search 
procedures involved. However, unless the location of each of these points, 
the x,(i)’s, corresponds to an even number of iteration intervals, Ax, the use 
of this subroutine is the most convenient. 

The SIMULTANEOUS subroutine is ideally suited for solving the 
boundary inputs, the B,,’s. Referring to this subroutine, as described in 
Chapter 5, the x array corresponds to the B,, array here; the y,, array be- 
comes the B,,,, array; the y array, the B,,, array. The subroutine itself 
computes B,,,., and adjusts the B,, array so that these errors are made smaller 
than the specified error tolerances. When this subroutine indicates that 
FINISH = true, the correct boundary conditions have been obtained. 

The algebraic relationship between boundary conditions and boundary 
inputs is a linear one in the type of beam-bending problem discussed thus 
far; hence, in theory, only one trial of the SIMULTANEOUS subroutine 
should be required. However, because of round-off errors, a second trial 
is often necessary before error tolerances are met and FINISH = true. If 
the problem was a nonlinear one, as it would be if the factor EJ was a func- 
tion of M(true with many materials, and with any material once the elastic 
limited has been exceeded), such linear relations would no longer apply 
and more trials would be required of the SIMULTANEOUS subroutine. 

The digital simulation program must also accommodate the possibility 
of a Type 2 or Type 3 support’s losing contact (i.e., disengaging with the 
beam). This is taken care of by observing the algabraic sign of the forces 
applied at such points (these will be boundary inputs B,,). As soon as the 
value of the corresponding B,, assumes the wrong sign, the value of B,, 
is set to zero and this B,,, is removed as a boundary input; the height of the 
support point y, is also removed as a boundary-condition specification, 
Byyec: The number of boundary conditions to be accommodated is therefore 
reduced accordingly. 

It is convenient to use a logical array, ENGAGE( i ), to indicate whether 
there is an engagement of the Type 2 or Type 3 support with the beam at 
the ith force-application point. ENGAGE(i ) initially is assumed true; it is 
changed to false when loss of engagement is observed. Provisions must be 
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made to observe a possible reengagement during the trial runs; this could 
occur only if more than one support were in this type category. Tests for 
engagement or disengagement are not made during perturbations of the 
SIMULTANEOUS subroutine, only during actual trial runs following such 
perturbation tests. 

Figure 7-7 is a general flow diagram illustrating the basic operations 
involved. A more detailed version, in the form of a Fortran IV program, 
is shown in Appendix 7A. This program is general in the sense that it can 
handle any number of force-application points (within the range of computer 
storage capacity) of any of the five types described. Figure 7-8 illustrates 
one test case, employing this program, involving a 10-ft beam with a can- 
tilever support at x = 0 (where y is defined as zero) and Type 2 support points 
at x = 2.5 and 7.5 ft. Figure 7-9 is a typical printout for one case. Figure 
7-10 shows how the beam deflection changes as the two point supports are 
being progressively lowered. Both supports are initially at the same level 
as the left-hand cantilever support (y = 0). First the outer support is pro- 
gressively lowered to —0.04 ft. By this time, as shown, it loses contact with 
the beam. Then the inner support is lowered progressively to —0.01 ft; during 
this process the outer support first regains contact and then the inner support 
loses contact. The outer support is then lowered progressively to —0.08 ft; 
the outer support again loses contact and the only support remaining is the 
cantilever support at x = 0. 

It should be pointed out that the program shown in Figure 7-7, and 
in more detail in Appendix 7A, represents a compromise between ease of 
programming by making use of standard subroutine modules already avail- 
able and speed of execution; in many problems of this type, not enough 
different runs are to be made for the latter to be an important consideration 
for a modern high-speed computer. When the program is to be used repeat- 
edly, there are a number of modifications (that do complicate the program) 
that could reduce execution time. 


7-6 Example of a Position-Control System 


This present example of a boundary-value problem is a relatively classical 
one used to show how parameters rather than initial conditions may require 
adjustment to establish prescribed boundary conditions. To avoid undue 
complication of the explanation, a simple version of this general problem 
has been chosen which does have a ready analytic solution. However, the 
approach used is generally applicable to other more complex versions where 
analytic solutions are not feasible. 

The problem consists of that of positioning a mass M along linear 


Read length, d; number of force application points, N; 
specified iteration interval, Ax,,.,; tolerance for com- 
parator, x,,); tolerances for boundary errors; range 
estimate of variables (to establish size of initial 
perturbations); type of each special point (Figure 
7-1), TYPE (i); Xp of each point; y, of each support 
point; F,, of each force application (Type 1) point; 
(dy/dx), of each cantilever support point. 


Temporarily set ENGAGE array elements to true 


for each Type 2 or 3 point 


Initialization for COMPAR and SIMULTANEOUS modules 


first consider point | 
atx=0 


return for new trial or 
perturbation 


1, 4, or 5 2 or3 


PERTURBATING 
or (TRIALS = 0) 


test for 
change in 
ENGAGE (1) 


Previously 
engaged? 


Still 
engaged 
% 


Re- 
engaged 
? 


FIGURE 7-7 
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ENGAGE(1) = true 
TRIALS = 0 


ENGAGE(1) = false 
TRIALS =0 


Set B;,(1) and B;,,(2) to zero; 
set initial AB,,(1) and AB, (2) on basis 
of support type and range estimates 


Set initial conditions for point | at x = 0: 


Type 2 or 3 if Type 2 or 3 if ENGAGE(1) 
Type | ENGAGE(1)= false = true; Type 4 Type 5 
S=F>(1) S=0 S=Bin(1) S=B;,(1) 
M=0° M=0 M=0 S=Bin(2) 
y= By (1) y= Bin(l) y=yp(1) y=yp(V) 
dy/dx = Bi,(2) dy/dx = Bin (2) dy /dx = Bin (2) dy/dx = (dy/dx),(1) 


Initialization for INTEGRATE subroutine :| 


for comparator; initialize 
this at start of every run 


iterative return 


Whenever NEWX = true (common with 
NEWTIME in INTEGRATE subroutine) 
establish new (1/E/) and new w(x) 


FIGURE 7-7 (cont'd) 
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not at force 
application point 
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Call COMPAR and SETDT subroutines 
to establish when each of the suc- 

¢ points (excluding point | 

0) has been reached; when 
s, STATUS becomes 4, and i, 
the point reached, will be SEARCH 
alls 


at force 
application 
point 


Repeat the procedure shown 
on previous pages following 
TYPE (1) 2 or 3 branch to 
determine if there was change 
in state of ENGAGE (i) 


FIGURE 7-7 (cont'd) 
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Set B;,,’s associated 
with this point to 
zero; set intial 
B;,,’s on basis of 
range estimates read 
in 


jis count of Bj,’s 
k is count of B,,’s 


Establish boundary conditions and introduce boundary inputs for 
this ith point: 


Type 2 or 3 if Type 4; Type 2 or 
ENGAGE(1) 3 if ENGAGE(1) 


Type | = false = tme — 5 
E = : J=STB,G 
S=S+F,(i) no action taken Peer a prea a 
ee Boys) = 


spec Bepoc(K) i 
Boustk +1) 2 dy/dx 


Byyoclk + 1) = (dy/dx)y(O) 


forces and 


Bops(k) ble) moments 
Bypoo(k) =0 must add 
Boys(K +1) =M_ | to zero at 
Bspoclk + 1) =0 end of 


beam 


STATUS = 2 or 3 
count of Bj,,/, and 
count Of Boongs k, 
should now be equal 
at end of beam;A 
matrix will be of 
dimension k xj = 
ix] 


normal iterations 
no special point 


FIGURE 7-7 (cont'd) 
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Print decision: 
print output list (e.g., 
x,y, dy/dx, S, M) at 
the desired print 
increments 


CALL SIMULTANEOUS 
subroutine 


return for new 
trial 


perturbation test 
or intermediate 
pass of integra- 
tion subroutine 


CALL INTEGRATE subroutine: 
ie, S=S4f* w(x) dx; 
M=M+f~ Sax; 

dy _dy 


freee J 
de dx EPS. Max: 


iy + @ dx 


iterative return 


FIGURE 7-7 (cont'd) 
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top view, showing taper of beam 


FIGURE 7-8 


coordinates so that it will attain a prescribed position within a tolerance 
-te, and also a prescribed velocity, both at some specified instant of time 
t, after correction first has been initiated. These are the prescribed boundary 
conditions. To this end a force of fixed magnitude f,, is to be selected that 
can be used to either accelerate or decelerate the mass. The parameters to 
be selected to meet these boundary conditions consist of this force magnitude 
fm and the time of its sign reversal, as established by a controller parameter 
a. Figure 7-11 illustrates the mechanical situation described. The actual 
position of the controller mass is described as c; the position desired as r. 
(A revised version of this problem consists of the situation where f,, is pre- 
scribed as the maximum value of the force that is available; then time ¢,, 
when the boundary conditions of prescribed position and velocity are met, 
is to be made a minimum. This then becomes a different type of problem, 
an optimization problem, the subject of Chapter 8.) 

Figure 7-12 is a block diagram of this system including a suggested 
form of controller. The proposed controller is one that governs the switching 
between a positive f,, and a negative f,, on the basis of some combination 
of the error e = r — c, and the error rate é = * — ¢. In this version of the 
problem, in order to limit the number of parameters to be adjusted, the 
combination of e and é used is linear (i.e., the control signal m that established 
the sign of f is made equal to e + aé). When m is positive, a positive f,, is 
applied; when negative, a negative f,,. If a is selected properly, the force 
will switch algebraic signs at the proper instant to meet the boundary condi- 
tions. The value of a necessary to accomplish this will naturally depend upon 
the disturbance of r that is applied. 

In Figure 7-12 the contactor has been modified to represent a more 
practical situation. After correction has been accomplished, there should 
be some provision for the force f being zero as well as + f,,. (Failing to provide 
for this could result in a rapid oscillation between plus and minus yalues of 


x Ww 


-0.0 
50 -120.00 
0.500 -240.00 
0.750 -360.00 
1.000 -480.00 
1.250 -600.00 
1.500 -720.00 
1.750 -839.99 
2.000 -959.99 
2.250 -1079.99 
2.500 -1200.00 


2.500 -1200.00 
2.750 -1320.00 
3.000 -1440.00 
3.250 -1559.99 
3.500 -1679.99 
3.750 -1799.99 
4.000 -1919.99 
4.250 -2039.99 
4.500 -2159.98 
4.750 -2279.98 
5.000 -2399.98 
5.250 -2519.98 
5.500 -2639.98 
5.750 -2759.98 
6.000 -2879.97 
6.250 -2999.97 
6.500 -3119.97 
6.750 -3239.97 
7.000 -3359.97 
7.250 -3479.96 
7.500 -3600.00 


7.500 -3600.00 
7.750 -3720.00 
8.000 -3840.00 
8.250 -3959.99 
8.500 -4079.99 
8.750 -4199.99 
9.000 -4319.99 
9.250 -4439.98 
9.500 -4559.98 
9.750 -4679.98 


EI Bg DY/DX M. s 
CANTILEVER SUPPORT OF HEIGHT 0.0 AND SLOPE 0.0 
PRODUCING MOMENT 51881. AND FORCE -60754.1 
0.500E 08 0.0 0.0 51881. -60754.1 
0.494E 08 0.00003 0.00022 36691. -60769.0 
0.487E 08 0.00011 0.00037 21494. -60814.0 
0.481E 08 0.00021 0.00044 6282. -60889.0 
0.475B 08 0.00032 0.00044 -8953. -60994.0 
0.469E 08 0.00042 0.00035 -24218. -61129.0 
0.463E 08 0.00049 0.00018 -39520. -61294.0 
0.456E 08 0.00050 -0.00008 -54867. -61489.0 
0.450E 08 0.00044 -0.00043 -70267. -61714.0 
0.4448 08 0.00028 -0.00086 -85727. -61969.0 
0.437E 08 0.00000 -0.00139 -101255. -62254.0 
POINT SUPPORT OF HEIGHT 0.0 WITH FORCE 84754.5 
0.4357E 08 0.00000 -0.00139 -101255. 22500.5 
0.431E 08 -0.00042 -0.00196 -95669. 22185.5 
0.425E 08 -0.00098 -0.00250 -90165. 21840.5 
0.419E 08 -0.00167 -0.00302 -84751. 21465.5 
0.413E 08 -0.00249 -0.00351 -79434. 21060.5 
0.406E 08 -0.00342 -0.00598 -74223. 20625.5 
0.400E 08 -0.00448 -0.00443 -69124. 20160.5 
0.394E 08 -0.00564 -0.00485 -64145. 19665.5 
0.388E 08 -0.00690 -0.00524 -59293. 19140.5 
0.381E 08 -0.00825 -0.00561 -54577. 18585.5 
0.375E 08 -0.00970 -0.00596 -50003. 18000.5 
0.369E 08 -0.01123 -0.00628 -45579. 17385.5 
0.363E 08 -0.01284 -0.00658 -41313. 16740.4 
0.356E 08 -0.01452 -0.00685 -37211. 16065.4 
0.350E 08 -0.01626 -0.00710 -33282. 15360.4 
0.344E 08 -0.01806 -0.00732 -29534. 14625.4 
0.338E 08 -0.01992 -0.00753 -25972. 13860.4 
0.351E 08 -0.02183 -0.00771 -22606. 13065.4 
0.325E 08 -0.02377 -0.00787 -19442. 12240.4 
0.319E 08 -0.02576 -0.00801 -16488. 11385.4 
0.512E 08 -0.02778 -0.00813 -13751. 10500.1 
DISENGAGED POINT SUPPORT OF HEIGHT -0.0400 
0.312E 08 -0.02778 -0.00813 -13751. 10500.1 
0.306E 08 -0.02982 -0.00823 -11240. 9585.1 
0.300E 08 -0.03189 -0.00831 -8961. 8640.1 
0.294E 08 -0.03398 -0.00838 -6922. 7665.1 
0.288E 08 -0.03608 -0.00843 -5131. 6660.1 
0.281E 08 -0.03819 -0.00847 -3594., 5625.1 
0.275E 08 -0.04031 -0.00849 -2321. 4560.1 
0.269E 08 -0.04244 -0.00851 -1317. 3465.1 
0.263E 08 -0.04457 -0.00852 -591. 2540.1 
0.256E 08 -0.04670 -0.00852 -149. 1185.1 
0.250E 08 -0.04883 -0.00852 aul. =07.2 


10.000 -4800.00 


FIGURE 7-9 
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Boundary-Value Problems 


w(x) = 480x Ib/ft 


yt EI = (5 — 0,25x)107 Ib-ft? 

C A 
~0.02 outer support 

oe lowered 
—— _ outer support has _—> 
—0,04 lost contact A 
(a) 
y, ft 
0 


a 
0.02 F inner support 
loses contact inner support 
-0.04 dlowereds 
outer support 
regains contact 
(b) 


Pea 


0.02 » 
outer support 
—0.04 lowered 
—0.06 
outer support 
—0.08 again loses contact 
—-0.10 (c) 
CR a el en et Hae PRY be) I a 
Or TRE BRE AS: AG er amet O, 
FIGURE 7-10 
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fm after the boundary conditions have been met.) This provision is shown 
in Figure 7-12 by introducing an inactive zone (as discussed in Chapter 6), 
designated as e,, in the contactor operation. 
In Figure 7-12 the parameters a and f,, are shown as signals entering 
their respective blocks. This is done to indicate that these parameters are 
to be adjustable. They will be adjusted to satisfy the stated boundary con- 
ditions, 


e(t,) =0 
é(t,) = 0 


(7-13) 
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either one or neither 
of these forces might 


be applied 
f, —— ~f, 
| velocity, ¢ 
+ displacement 
c 
desired 
displacement 
r 
velocity, F 
FIGURE 7-11 
f 


m 


controller 


contactor 


FIGURE 7-12 


7-7 Dimensionless Representation of the Problem 


If this example is to be considered as representing a general problem, rather 
than involving only specific ranges of r and * and a specific mass M, it will 
be convenient to present it in a dimensionless form. The results obtained 
would then be of more general utility, Furthermore, this procedure will 
simplify greatly the problem of machine-variable scaling when an analog 
computer is used for the purpose of simulation, and it will avoid the neces- 
sity of changing machine scale factors when the size of the mass or the range 
of r and # should be changed. 

The dimensionless representation will be based upon the value of the 
mass M and the following two constants: 
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1. r,, which is equal to or somewhat greater than the maximum 
magnitude of the reference position r. 

2. tm, Which is equal to or somewhat greater than the maximum 
magnitude of the prescribed response time 1,. 


Both r,, and t,, should be selected as round numbers in whatever units are 
employed to simplify the conversion between real and dimensionless quan- 
tities. 

The dimensional variables involved in the problem are converted to a 
dimensionless form as follows: 


controlled position, c, is represented ws ec (7-14a) 
by vm 
reference position, r, is represented by p= + (7-14b) 
error, ¢, is represented by €= = (7-14c) 
control signal, m, is represented by “= 2 (7-14d) 
2 
applied force, f, is represented by ¢= mw (7-14e) 
controlled velocity, ¢, is represented palm @ (7-14f) 
by lm 
reference position velocity, 7, is rep- ee 7-14 
resented by ip re us ( 2) 
elapsed time, f, is represented by t= a (7-14h) 
time derivative operator, s, is repre- Ais (7-14i) 


sented by 
The adjustable parameters will be represented in dimensionless form as 
follows: 
controller rate constant, a, is rep- eae (7-15a) 
resented by ie 


control force magnitude, f,,, is rep- wet 7156 
resented by $m = MrJ™ (7-15b) 


Also, the inactive zone introduced, e,, equal also to the error tolerance 
range, is represented in dimensionless form as 
es (7-16) 


lm 
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On this basis the block diagram of Figure 7-12 may be converted to 
one of simpler form, shown in Figure 7-13. The operation (1 + «A) in Figure 
7-13 implies differentiation, usually inadvisable with either analog or digital 
simulation. For this reason the modification of the. block diagram to the form 
shown in Figure 7-14 is proposed as a model for purposes of simulation. 

In Figure 7-14, p and # will be functions of t, established either as 
input data or derived from another program. 


FIGURE 7-13 


FIGURE 7-14 


7-8 Analog Simulation of the Problem 


Figure 7-15 illustrates the analog simulation of this problem. It should be 
noted that since all quantities are expressed in a dimensionless form, appro- 
priate machine variables may be determined simply by multiplying these 
quantities by Va, the computer's reference voltage. This is, for example, 


Vn =x 


It should also be noted that since « is adjustable, it is introduced by 
means of a multiplier rather than by a potentiometer. (Since this program 


GL-Z 3YNDIS 


doyeIBayUt 
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is to be operated in a high-speed-repetitive mode, a quarter-square type of 
multiplier might be the most appropriate.) 

The contactor operation indicated is accomplished most easily by 
means of comparators, as shown in Figure 7-15, Since these must operate 
in a high-speed-repetitive mode, conventional electromechanical comparators 
may not be suitable. When they are not, electronic gating circuits equiva- 
lent to the comparator arrangement shown may be employed instead. 
Another alternative is the use of a combination inactive zone and switching 
circuit, as discussed in Section 6-7. 

A time-scale factor k, should be chosen so that 1/k, is less than the 
period of the computer when in the high-speed-repetitive mode (so that 
the simulation will be completed before the period of interest has expired 
and the reset period has begun). 

It is also necessary to represent, in equivalent machine volts, an indi- 
cation of elapsed time t. This is accomplished by the additional integrator 
that develops the voltage TV. This integrator is used to actuate the track— 
hold combination when 7 attains its specified value tp. The values of € and 
é, the two pertinent boundary conditions, are then sampled and held once 
each repetitive cycle, as they apply when t = Ta. 


7-9 Adjusting Parameters to Satisfy Boundary 
Conditions 


The outer (parameter-adjustment) loop is closed in a manner similar to that 
shown in the previous example of Figure 7-6. For the example now being 
considered, a program to accomplish this is shown in Figure 7-16. Again, 
since an intuitive selection of the algebraic sign associated with parameter 
correction may be deceptive, sign-reversal switches are provided. Because 
there are only four possible feedback loops involved here for parameter 
adjustment, trial-and-error adjustment to achieve a stable and reasonably 
rapid correction of parameters is more feasible than with the preceding 
example (where there were nine such possible loops). 

Optimum correction of boundary errors is obtained only by using the 
procedure described in Section 7-3, employing the noninteracting-control 
concept. In order to find the optimum potentiometer settings, test pertur- 
bations are necessary. 


7-10 Digital Simulation 
of the Positional-Control-System Problem 


Digital simulation for this problem follows the same general principles that 
were described for the beam-bending problem; the correct boundary inputs, 
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sign-reversing 
console switches 


loop-gain potentiometers 


parameter-adjustment 
integrators 


Analog circuit of 
Figure 7-15 


FIGURE 7-16 


a and @,,, are established by the simultaneous-equation module so that the 
boundary conditions e(z,) and €(t,) both attain their specified values of zero. 
Three comparators may be employed, just as Figure 7-15 shows. Two would 
be employed to establish the inactive-zone boundaries at +-A and to deter- 
mine when they are crossed by the actuating signal yw. The third could be used 
to establish when t = t,. This third comparator would not be needed if 
7, were made to equal some integer number of interation intervals, At; then 
a simple termination of the run when t = 1, would suffice. Greater flexibility 
without this restriction on t, is, however, achieved by using the third com- 
parator, even though it does involve some cost of speed of execution. 

Figure 7-17 shows a flow diagram for simulating this problem. Note 
that to accommodate the possibility of the input p(t) being various func- 
tions of t, p(t) and f(t) are established by a special command-function 
subroutine. 

It has been mentioned that one of the advantages of using such a dimen- 
sionless version of the problem is the avoidance of scaling difficulties. Note 
that such difficulties also arise with digital simulation as far as tolerances 
of comparators and of simultaneous-equation modules are concerned. Here 
such difficulties could be avoided. 


Read 74, Yo, At, Ato Tr A 


TRIALSmax = 20: STATE = 2; COMPS = 3; tol(1) = tol(2) = tol(3) = 0.001; 
TRIALS = 1; FINISH = false; Boye. (1) = Bypec (2) = 0; 
PERTURBATIONS = false; n = 2. 


initialization for COMPAR , 

SIMULTANEOUS, INTEGRATE 

modules 

initial trial 

7 = 0; ABin(1) = ABiq(2) = 0.15 Om = Waluseabonmusky 
inputs and per- 

turbations 

EQUIVALENCE (Bj, (1), @), 

(Byy(2), dy), INC), @), 


(OUT(1), 7), (IN(2), Dy/DT), 
(OUT(2), y) 


return for new trial run or 
perturbation test 


NEWTIME=true; STATUS=1 


remaining ini- 
tialization for 


LASTPASS = true; 


modules 
= 0; Tp = —0.5AT Y= 05 Y= Fo] Beneral 
beh) sp 17 Yo+ TF) initialization 
CALL COMMAND(r, p, p) 
establish 
initial 
conditions 


of ¢ 


FIGURE 7-17 
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iterative return 


2 


CALL COMMAND (7, p, 6) 


algebraic relations 
of block diagram 


[ SIG) =n—A; SIG(2)=-p—- A; SIG(3)=7-7, comparator 


inputs 
— 


CALL COMPAR (ACT, SIG, Ar, TOL, 


TRIALS yx, STATUS, SEARCH, COMPS) 


ao: SmI 


CALL SETDT(STATUS, Argprc, At, NEWDT, 7) 


in search 


FIGURE 7-17 (cont'd) 
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FINISH =3 end of run 
9 


CALL SIMULTANEOUS (n, 

Bin, Bspec, TOL, Beonp, 

ABin, FINISH, TRIALS, 
TRIALSy ax, PERTURBATING) 


5 


FIGURE 7-17 (cont'd) 
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Print 7, p, 2, 7,7 


return for new trial 
or perturbation run 


new 


dy/dt = ¥ | integrator 


input 


CALL INTEGRATE(STATE, LASTPASS, 
NEWTIME, 7, At, NEWDT, IN, OUT) 


iterative return 


FIGURE 7-17 (cont'd) 


7-11 Alternative Procedure for Parameter Correction 

The analog and digital programs described here, applying to this second 

example, were based upon meeting the following boundary conditions: 
e(t)=0 and é&(t)=0 when t=T, 

This is a direct expression as the conditions were specified and hence the 

most obvious basis of a program for parameter correction. It is not neces- 


sarily the most effective approach as far as convergence of solution is con- 
cerned, First, a new variable, t,, may be defined implicitly as follows: 


ee (7-17) 


This is defining t, as the value of t when € first becomes zero. The boundary 
conditions will then be described as 


Bops(1) = T Bypec(1) = T, 


. (7-18) 
Bovs(2) = (To) Bapec(2) = A(o) 
The boundary inputs still remain 
B,, (1) = 
in(1) = @ (7-19) 
Bi(2) = bm 


7-12 Application of Boundary-Value Problems 


In general, boundary-value problems arise whenever physical situations are 
to be simulated that can be described by differential equations and not as 
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many initial conditions are known as there are states. In addition, in Chapter 
8 is discussed the determination of the optimum parameters to minimize 
certain cost functions or to maximize certain merit functions. These functions 
are in a sense boundary conditions, and the methods described here will 
be applicable. 

Chapter 10 deals with the simulation of distributed parameter systems, 
describable by partial differential equations. Under these circumstances, 
the initial conditions will rarely coincide with the specified boundary con- 
ditions and, again, the techniques just described will be necessary. 


Suggested Problems 


7-1. 

(a) Prepare and execute an analog program for handling the second example 
of this chapter when the alternative technique for parameter correc- 
tion suggested in Section 7-11 is employed. 

(b) Repeat (a), this time with a digital program. 


7-2. A perfectly flexible cable of weight w Ib/ft is stretched between two 
horizontal support points, both at the same level, and located / ft apart. 
The cable supports two concentrated loads of W, and W, Ib located at dis- 
tances x, and x,, respectively, from the left-hand support. The right-hand 
end of the cable is tightened by a winch until the lowest point on the cable 
sags no more than d ft below the support points. Find the tension force that 
must be applied by the winch and the contour of the cable. Typical values 
for scaling: 


7 = 150 ft 
d=0.5 ft 

w = 0.1 1b/ft 
W, = W,=5lb 
x, = 30ft 

x, = 90 ft 


7-3. Figure P7-3 illustrates the situation where 50 liters/min of liquid is to 
be poured into the first of three differently shaped tanks connected in cascade. 
Each tank has a bottom outlet furnished with a valve whose flow resistance, 
R, is to be established, Since the valves are essentially sharp-edged orifices, 
the relationship between the head (height of liquid in the tank involved) 
and flow from that tank will be 


head: h = RQ? cm 


with Q in liters/min. 


356 Boundary-Value Problems Chap. 7 


Qo = 50 liters/min 


all dimensions in centi- 
meters; all tanks have 
40 20 width (the dimension per- 


Q, pendicular to the paper) 
‘ ad of 40 cm 
R 
Pes a sa 
tank 1 
2 
— 
aoe aie aha 
the 
tank 2 y 
tank 3 
FIGURE P7-3 


The required valve resistances R,, R,, and R, are to be established to 
meet the requirement that with the tanks initially empty the liquid level in 
all three will be exactly 40 cm in 7 minutes. Establish both analog and digital 
programs for finding the necessary values of R. (There will be a minimum 
value of 7 below which this requirement can never be satisfied; find this 
value as well.) Note that the R’s must remain constant for 0 < t < T; this 
rule prevents the application of an obvious control strategy. 
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Appendix 7A: 

Fortran IV Program 
That Produced Results 
of Figure 7-9 


BEAM BENDING SIMULATION 1/14/69 RJK 

INTEGER TYPE, COMPS ,MAXTLS, STATE, TRIALS, STATUS, 
1SEARCH 

REAL M,MTOL, INTIN, INTOUT 

LOGICAL FINISH, PERT, LSTPAS , NEWX, NEWDX, ACT, 
1ENGAGE, MORE 

DIMENSION TYPE(10),FP(10),YP(10),DYDXP(10), 
1DBIN(18),BIN(18),XP(10),JLOC(10),KLOC(10), 
2BSPEC(18),BTOL(18),A(18,18),ACT(10),SIG(10), 
STOLC(10), INTIN(10), INTOUT(10),BCOND(18),XLAST 
4(10), YLAST(10), ENGAGE(10) 

EQUIVALENCE( INTOUT(1),S),(INTIN(2),SHEAR), 
1(INTOUT(2),M),(INTOUT(3),DYDX),(INTIN(4), 
2SLOPE),(INTOUT(4),Y) 

READ 100,D,N,DXSPEC,DXPT, TOLK, TOLY, TOLF, TOLM, 
1RANGEY , RANGEF , RANGEM 

FORMAT(F10.3,110,3F10.3,/F10.5,F10.3,F10.1, 
1F10.3,2F10.0) 
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201 READ 101,MORE,(TYPE(I),I=1,N) 
101 FORMAT(L2,13,915) 
DO 4 I=1,N 
L=TYPE(I) 
GO TO (1,2,2,2,3), 
1 ‘READ 103,XP(I), FP(1) 
103 FORMAT(F10.3,2F10.5) 
GO TO 4 
2 READ 103,XP(I),YP(I) 
ENGAGE(I)=.TRUE. 
GO TO 4 
3 READ 103,XP(I),YP(I),DYDXP(I) 
4 CONTINUE 
MAXTLS=20 
STATE=4 
COMPS=N-1 
DO 5 I=1,COMPS 
5  ‘TOLC(I)=TOLX 
TRIALS-O 
FINISH=. FALSE. 
PERT=.FALSE. 
PRINT 108 
108 FORMAT(1H1,17X,1HX,8X,1HW,7X,2HBI,11X,1HY,6X, 
15HDY/DX, 8X, 1HM, 9X,1HS) 
c RETURN FOR NEW TRIAL RUN 
6  LeTYPE(1) 
GO TO (9,7,7,12,15),L 
7  IB(.NOT.ENGAGE(1))GO TO 8 
IF(PERT.OR.(TRIALS.EQ.0)GO TO 12 
IF((TYPE(1).EQ.3).AND.(BIN(1).GH.0))GO TO 12 
IF((TYPE(1).HQ.2).AND.(BIN(1).LE.0))GO TO 12 
c FIRST POINT SUPPORT JUST FOUND DISENGAGED 
ENGAGE(1)=.FALSE. 
TRIALS=0 
FP(1)=0. 
BIN(1)=¥P(1) 
GO TO 10 
8  IF(PERT.OR.(TRIALS.EQ.0))GO TO 9 
IF((TYPE(1).2Q.3).AND.(Y.GE.YP(1)))GO TO 9 
IF((TYPE(1).BQ.2).AND.(¥.LE,YP(1)))GO TO 9 
c POINT SUPPORT JUST FOUND REENGAGED 
ENGAGE(1)=. TRUE. 
TRIALS=0 
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GO TO 13 
9 IF(TRIALS.NE.0)GO TO 11 
BIN(1)=0. 
DBIN(2)=.1#RANGEY/D 
BIN(2)=0. 
10 DBIN(I)=.1#RANGEY 
11 S=FP(1) 
M-0. 
Y=BIN(1) 
DYDX=BIN(2) 
IF(.NOT.FINISH)GO TO 17 
IF(TYPE(1).EQ.1)PRINT 105,FP(1) 
105 FORMAT(10X,20HFORCE APPL. POINT OF,F10.1,5H 
1LBS. ) 
IF(TYPE(1).NE.1)PRINT 109,YP(1) 
109 FORMAT(10X,34HDISENGAGED POINT SUPPORT OF 
1HEIGHT,F8.4) 
GO TO 17 
12 IF(TRIALS.NE.0)GO TO 14 
13. BIN(1)-0. 
DBIN(1)=.1#RANGEF 
BIN(2)=0. 
DBIN(2)=.1*RANGEY/D 
14 S=BIN(1) 
M-0. 
Y-YP(1) 
DYDX-=BIN(2) 
IF(FINISH)PRINT 106,YP(1),BIN(1) 
106 FORMAT(10X,23HPOINT SUPPORT OF HEIGHT,F10.5,114 
1WITH FORCE, F10.1) 
GO TO 17 
15  IF(TRIALS.NE.O)GO TO 16 
BIN(1)=0. 
BIN(2)=0. 
DBIN(1)=.1#RANGEF 
DBIN(2)=.1#RANGEM 
16 S=BIN(1) 
M=BIN(2) 
Y=YP(1) 
DYDX=DYDXP(1) 
IF(FINISH)PRINT 107,YP(1),DYDXP(1),BIN(2), 
1BIN(1) 
107 FORMAT(10X,28HCANTILEVER SUPPORT OF HEIGHT, 
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1F10.5,10H AND SLOPE,F10.5,/10X,16HPRODUCING 
2MOMENT,F10.0,10H AND FORCH,F10.1) 


17 ~=~-K=0 
J=2 
LSTPAS=. TRUE. 
NEWX=. TRUE. 
STATUS=1 
X=0. 
XPT=-.5*DXSPEC 

C ITERATIVE RETURN 


18 IF(.NOT.NEWX)GO TO 19 
EI=EIFUNC(X) 
REI=1./HI 
W=WFUNC(X) 
19  IF(.NOT.LSTPAS)GO TO 37 
DO 20 I=1,COMPS 
20  SIG(I)=K-XP(I+1) 
I=0 
CALL COMPAR(ACT,SIG,DX,TOLC,MAXTLS , STATUS, 
1SEARCH, COMPS ,X) 
CALL SETDT( STATUS ,DXSPEC , DX, NEWDX,X) 
IF(STATUS-4)35,21,37 
C IF CONTINUES ON TO 21,NEW SPECIAL POINT ON BEAM 
1HAS BEEN REACHED 
21  I-SEARCH+1 
IF(FINISH)PRINT 104,X,W,E1I,Y,DYDX,M,S 
104 FORMAT(10X,F10.3,F10.2,B11.3,2F10.5,F10.0, 
1F10.1) 
L=TYPE(I) 
GO TO (24,22,22,27,27),L 
22 IF(.NOT.ENGAGE(I))GO TO 23 
IF(PERT.OR.(TRIALS.EQ.0))GO TO 27 
IF((TYPE(1).EQ.2).AND.(BIN(J+1).LE.0))GO TO 27 
IF((TYPE(I).EQ.3).AND.(BIN(J+1).GE.0))GO TO 27 
c THIS POINT SUPPORT JUST FOUND TO BE DISENGAGED 
ENGAGE(I)=.FALSE. 
TRIALS=O0 
FP(I)=0. 
GO TO 25 
23  IF(PERT.OR.(TRIALS.HQ.0))GO TO 24 
IF((TYPE(I).EQ.3).AND.(¥.GE.YP(I)))GO TO 24 
IF((TYPE(I).EQ.2).AND.(Y.LE.YP(I)))GO TO 24 
© THIS POINT SUPPORT JUST FOUND REENGAGED 
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24 
25 


26 


27 


28 


29 
291 


Appendix 7A: Fortran IV Program 


ENGAGE(I)=.TRUE. 
TRIALS=0 

BIN(J+1)=0. 

GO TO 27 

S=S+FP(I) 

IF(I.NE.N)GO TO 30 
K=K+1 

BCOND(K)=S 
IF(TRIALS.NE.O)GO TO 26 
BIOL(K)=TOLF 
BSPEC(K)=0. 

K=K+1 

BCOND(K)=M 
IF(TRIALS.NE.0)GO TO 30 
BTOL(K)=TOLM 
BSPEC(K)=0. 

GO TO 30 

J=J+1 

K=K+1 

BCOND(K)=Y 
IF(TRIALS.NE.0)GO TO 28 
BTOL(K)=TOLY 
BSPEC(K)=YP(1) 
DBIN(J)=.1#RANGEF 
BIN(J)=0. 

S=S+BIN(J) 
IF(TYPE(I).LT.5)GO TO 291 
J=d+1 

K=K+1 

BCOND(K )=DYDX 
IF(TRIALS.NE.0)GO TO 29 
BIOL(K)=TOLY/D 
BSPEC(K)=DYDXP(I) 
DBIN(J)=.14#RANGEM 
BIN(J)=0. 

M=M+BIN( J) 

IF(I.NE.N)GO TO 30 
K=K+1 

BCOND(K)=S 

K=K+1 

BCOND(K)=M 
IF(TRIALS.NE.0)GO TO 30 
BIOL(K)=TOLF 
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BIOL(K+1 )=TOLM 
BSPEC(K)=0. 
BSPEC(K+1)-=0. 
30 IF(.NOT.FINISH)GO TO 361 
L=TYPE(I) 
GO TO (31,52,32,33,34),L 
31 PRINT 105,FP(I) 
GO TO 36 
32  IF(ENGAGE(I))GO TO 33 
PRINT 109,YP(I) 


GO TO 36 

33 PRINT 102,YP(1),BIN(J) 
GO TO 36 

34 PRINT 107,YP(I),DYDXP(1),BIN(J-1),BIN(J) 
GO TO 36 


35  IF((.NOT.FINISH).OR.(X.LT.XPT))GO TO 37 
XPT=XPT+DXPT 
36 PRINT 104,X,W,EI,Y,DYDX,M,S 
IF(FINISH.AND.(I.EQ.N))GO TO 38 
361 IF(I.NE.N)GO TO 37 
CALL SIMEQ(J,BIN,BSPEC, BTOL, BCOND, FINISH, A, 
1TRIALS ,MAXTLS , DBIN, PERT ) 
GO TO 6 
37  SHEAR-S 
INTIN(1)=W 
INTIN( 3 )=M#REI 
SLOPE-DYDX 
CALL INT(STATE,DX,X,NEWDX, LSTPAS ,NEWX,XLAST, 
1YLAST, INTIN, INTOUT ) 
GO TO 18 
38  IF(MORE)GO TO 201 
STOP 
END 


Optimization of Simulated 8 
Systems 


8-1 Cost Functions and Merit Functions 


A system is said to be optimized with respect to its parameters when all 
its adjustable parameters are adjusted so that a cost function is minimized 
or a merit function is made a maximum. To clarify this further, cost func- 
tions and merit functions must be explained. This is done best by example. 
Suppose, in the last example of Chapter 7, illustrated by Figure 7-11, 
that it was desirable to move the mass M to its desired displacement in the 
minimum possible time (i.e., t,, rather than being made to attain some speci- 
fied value, is to attain a minimum possible value). [It will be assumed, for 
the purpose of this discussion that r(¢) and hence p(t) are step functions 
(i.e., p is constant and is zero for all positive 7).] If this is the only require- 
ment imposed on the system, then the meeting of this requirement will result 
in what is called optimum performance and the cost function, C, will be simply 
C= 1,(4, $n) (8-1) 
This function is described as a function of the parameters o and ¢,, on the basis 
of the assumption that these are the only parameters to be adjusted. (Let it be 
assumed that the inactive zone A has been specified and is not considered 
adjustable.) 
The example up to this point is not completely realistic. No finite opti- 
mum values of « and ¢,, will exist for this particular problem as it will be 
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found that C can always be made smaller by increasing ¢,, and then re- 
adjusting «. Obviously, the cost function as so defined is inadequate. Not all 
factors have been taken into consideration. In a practical situation there must 
be some limit imposed on ¢,,. This could be handled in either of two ways. 

The first method for making C, as defined in relation (8-1), a realistic 
cost function is to apply a constraint to ¢,,, as by adding the condition 


bm < by (8-2) 


where @, is some specified limit. With such a constraint optimum values of 
¢,, and a can be found. The results of an optimization study will show that 


Pmon = Ox (8-3) 


The optimum « may then be established. 

The second method is based on recognizing that the value of ¢,, given 
by (8-3) should be employed so that maximum use is being made of the 
corrective action available in this system. Then the cost function would 
have been considered from the start as a function of only one parameter, 
a. That is, 


C= 1,(a) (8-4) 


Either viewpoint will lead, of course, to the same result. 

This example is an oversimplified one and the optimum conditions 
could readily have been established by pencil-and-paper analysis. The reason 
for developing computer methods of optimization is, of course, to be able 
to optimize the more complicated systems usually encountered in practice 
that are not susceptible to such pencil-and-paper techniques. Nevertheless, 
it is advantageous to pursue this oversimplified example still further simply 
because the expected results are known and can be used to check any com- 
puter method of optimization that might be proposed. 

What the computer optimization procedure will actually accomplish 
will be to survey the relationship between cost function and the remaining 
adjustable parameter . It will see a relationship that, when plotted, appears 
roughly as in Figure 8-1. The optimum value of « is obviously that which 
makes C a mathematical minimum; i.e., C.y, = C(op.) = Cmine Optimiza- 
tion in this case involves the finding of extrema. 


Pp, %,, A specified 


opt FIGURE 8-1 
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The above example as discussed here illustrates a cost function. It 
could have been described as well as the problem of establishing the condi- 
tions for making a merit function a maximum. The merit function would 
have been M = 1/r,. As another example, in a chemical-processing problem 
the merit function might have been the yield of the desired product. 


8-2 Problem of Finding Extrema 


The discussion will be confined to those cases where there is only one adjust- 
able parameter, or where the problem has been reduced to that of adjust- 
ment of only one parameter, as in the case illustrated by Figure 8-1. This is 
the simplest type of optimization problem but may, even so, become com- 
plicated when the relationship between cost function and the parameter 
show more than one mathematical minimum, as in Figure 8-2. «, obviously 
represents the optimum «. It can easily be seen that unless precautions are 
taken a computer program searching for @,,, might erroneously decide on 
a, instead. 


ay coy 
FIGURE 8-2 


Another problem that might result is that an imposed constraint 
might prevent a true mathematical minimum from being attained. Suppose, 
in the example of Figure 8-1, that some constraint is imposed so that a < a, 
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where @&, < min» This situation is shown in Figure 8-3. Obviously, the opti- 
mum value of @ will then be «,. 


8-3 Optimization with More than One Adjustable 
Parameter 


Very often the cost function will remain a function of more than one adjust- 
able parameter and the problem cannot be described as a simple relationship 
that plots as in Figure 8-1. Suppose, for example, that the next degree of 
complication was involved, where there were two parameters to be adjusted, 
say a@(1) and a(2). The cost-function relationship might then be described 
mathematically as 


C = C[a(1), a(2)] (8-5) 
A three-dimensional plot would now be required to show this relationship 
in a manner similar to that of Figure 8-1. It can be pictured more readily, 


on paper, by plotting contours of constant C, as in a contour map. Ina typical 
problem such a map might appear as in Figure 8-4. Although C is assumed 


a(2) 


a1) 


FIGURE 8-4 


to be a continuous function of (1) and (2), contours are shown for integer 
values of C only. The optimum values of «(1) and «(2) are those where C = 5; 
this is at one of the minimum points on the contour. However, there are at 
least two other mathematical minima, both resulting in a C of 6, and pos- 
sibly other less apparent minima not discernible because of the coarseness 
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of the plot. This indicates that some definition of a practical minimum is 
necessary. (For example, in a geographical-contour problem, is every pothole 
considered a minimum point?) In any event, it is important that any opti- 
mization procedure arrive at the lowest minimum—in this example, where 
C=5. 

The more general problem may involve still more adjustable param- 
eters and it is no longer possible to discuss the problem graphically. The 
problem can still be considered in the mathematical sense and computer 
solutions may be feasible. A combination of n parameters, described as 
a(1), (2), ..., «(n), may be considered as an n-state vector and C as a scalar 
function of that vector. Again, constraints may be applied to some of the 
«’s, or to combinations of them, which will affect the methods of solution 
and the results that are obtained. 


8-4 General Survey of Techniques 
for Finding Optimum Parameters 


A host of literature has been written about optimization methods; not all 
of it is pertinent to the problems being discussed here. For example, many 
of the techniques proposed depend upon knowledge of the analytic form of 
C so that the partial derivatives of C with respect to the parameters may be 
expressed analytically instead of being determined, experimentally and 
approximately, by perturbation methods. 

As an example, optimization techniques are often used as the basis 
of methods for finding the complex roots of polynomials, as in the deter- 
mination of root loci for control systems. This problem does not relate 
directly to simulation but would be of interest, nevertheless, to those readers 
interested in feedback-control theory. The problem here is to find the roots 
of an equation of the form 

as" +a, Ss"! +... +as+a,=0 

In general, the values of s that will satisfy this equation (i.e., the roots) will 
be complex. They are described best in terms of their magnitude, |s|, and 
argument, /s. (This is preferable from a computation standpoint to a resolu- 
tion into real and imaginary parts, « and jw.) These two quantities are the 
parameters to be varied in a trial-and-error search for the roots. In general, 
for trial values of || and /s, a nonzero result will be obtained when the poly- 
nomial terms are added; i.e., 
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where € is the error which, for the correct root, should be zero. € also will 
in general be complex and can be expressed in terms of its real and imaginary 
parts: 


e€=u+jv 
Any positive definite function of u and v will be an appropriate cost function 
for the purpose of finding the roots. One possible cost function [1] is 
C=v+0 
Another possibility, claimed to result in a more rapid convergence of solution 
[2], is 


C=|ul +e] 
In any event, once an appropriate cost function has been defined, the prob- 
lem becomes one of optimization. In the process of search for the parameters 
|s| and /s that result in minimum C (minimum C is, of course, zero), the 
roots will be found. 

Because the relationship between C and the parameters can be expressed 
in analytic form, this problem can make use of optimization techniques that 
depend upon this knowledge; these techniques are, however, not of value 
in the optimization of most simulated systems where no such analytic form is 
possible. In the simulation problems of the type of concern here, the rela- 
tionship between C and the parameters can be established only by pertur- 
bation tests performed on a simulation model. The optimization techniques 
to be discussed here will assume that that is the case. These techniques could 
also be used to find the roots of polynomials according to the procedure 
discussed above but would result in longer execution times than when those 
techniques are employed that rely on the analytic knowledge of the relation- 
ships involved. 

Parameter optimization techniques may be divided into three general 
categories: 


1, The method of steepest descent (or steepest ascent when dealing 
with a merit rather than cost function). 

2. Relaxation methods. 

3. Random-scan methods. 


The method of steepest descent is based upon making the path of the param- 
eter corrections, when considered in the parameter space, orthogonal to 
the constant C contours and, naturally, in the direction of decreasing C. 
When finite trial adjustments of the «’s are made, as in digital optimization, 
these adjustments are made in a direction opposite to that of the vector 
representing the gradient of C([«]). That is, proceeding from trial starting 
values of the a’s, changes are made simultaneously in all the «’s so that 
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Aai(1) man 


Aa(2) gC 


a2) 
A=). jak. (8-6) 


dC 
don) 
The more “daring” the steps, the greater the value of k. As convergence is 
being reached, k should be decreased to avoid overshooting the correct solu- 
tion and then oscillating about it. 

The procedure is the same for analog simulation, except that a con- 
tinuous rather than stepwise adjustment of the parameters might then be 
feasible. The above relation still applies if the operator d/dt is substituted 
for A. Actual execution of these methods will be explained in more detail 
in the section to follow. 

Relaxation methods are based on finding the minimum C with respect 
to one parameter with all others kept constant. Then minimization is re- 
peated with the next parameter varied, etc. The cycle is repeated until C 
is recognized as a minimum within the specified region of tolerance. In other 
words, the following sequence of operations is employed: 


Aa(1) = — kit 


Aa(2) = — ksi 


Aa(n) 


(8-7) 


Aa(n) = — kik 


Aa(1) = — katy 


etc. 


There are a number of random-scan techniques. In their crudest form 
they consist of assigning a series of random combinations of values to the 
«’s until all of the n-dimensional [«] space within the range of interest has 
been reasonably filled. For each point (matched set) in the [%] space so estab- 
lished, the value of C is computed. Whenever the value of C is lower than 
any previously observed value, it is tentatively considered to represent the 
minimum. 

This random-scan method, while seemingly crude, is surprisingly effec- 
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tive for problems where the cost function is computed easily with short 
execution time. It becomes inefficient when the C computation is complex, 
as it is in most simulation problems. However, it does possess the advantage 
of not being fooled by mathematical minima that do not represent the 
extreme minimum, Steepest-descent and relaxation methods are, on the other 
hand, easily fooled and will converge on a false minimum unless the correct 
initial trial values are specified. Hence random-scan methods may be useful 
for providing a proper starting point for these other, more rapidly convergent, 
techniques. 


8-5 Optimization Technique with One Adjustable 
Parameter—Analog Means 


When there is only one adjustable parameter @ the situation may be 
described in terms of a plot of cost function versus a, as in Figures 8-1, 8-2, 
and 8-3. Then the steepest-descent methods simply amount to finding the 
algebraic sign of\ajC/da and varying in the opposite sense. The relaxation 
method amounts to the same thing; i.e., there is no distinction between these 
two methods when only one adjustable parameter is involved. 

With analog techniques being used to find the conditions for minimum 
C, this minimum is in theory being approached continuously and there 
would be no danger of missing the minimum by going beyond it, as might 
be the case when finite increments are employed. In practice this is not com- 
pletely true. Normally, the cost function C is computed by a simulation pro- 
gram performed in high-speed-repetitive operation; its value is held from 
cycle to cycle of the repetitive process by track—hold means. As a conse- 
quence, finite increments of « actually do result; however, they may be made 
exceedingly fine by employing a high frequency of repetition and by making 
the analog optimization process occur reasonably slowly. Then no special 
precautions need be taken to slow down the rate at which @ is varied as 
the minimum is approached. When it is sensed that the slope magnitude 
|dC/da| is less than some specified tolerance value, a minimum point is 
considered to have been reached and the search is halted. 

Figure 8-5 shows an analog program for accomplishing this. The 
actual process being optimized is simulated in a high-speed-repetitive mode 
and two cascaded ratchet circuits, actuated by the comparator marking the 
end of the trial run (actuated in turn by the timing integrator within the 
high-speed-repetitive program), store C(n) and C(n — 1). Their difference, 
VC(n), is then obtained. When {[VC(n) > 0] M [&(n) > O)} U {[VC(n) < 0] 
O (a(n) < 0} [i-e., when VC(m) and a(n) possess the same algebraic sign], 
a positive slope of the C versus « relationship is indicated for that operating 
point and a negative @ is called for during the next, (n + 1)th, trial; other- 
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wise, a positive & is called for. In Figure 8-5 this logic is handled by com- 
parators 1 and 2; 1 determines the sign of VC(n) and 2 the sign of a(n). A 
fixed magnitude for the rate of change of o is established by the associated 
potentiometer, and the combination of these two comparators establishes 
the proper algebraic sign for the next trial. 

The search procedure should be terminated and the value of « then 
in effect should be accepted as the optimum when | dC/da| is less than some 
specified tolerance value. dC/do, is related to the values of VC(n), 1, and 
& as follows: 


where 1, is the period of repetition of the high-speed-repetitive operation. 
Hence the tolerance range, within which the minimum may be assumed to 
have been found, may be expressed as some value of VC(n), or tolye. Com- 
parator 3, therefore, is included to interrupt the input to the integrator 
producing o and essentially to place it in hold when this final condition 
has been reached. 

Further complications are introduced by the fact that until the first 
trial run of the HRO circuit has been completed (while » = 0), comparator 
3 would not be actuated [as VC(n) = VC(0) = 0] and the correction proce- 
dure would be interrupted at its very start. Hence, comparator 4 is also 
needed to bypass the interrupting action of comparator 3 during this first 
interval only. 

Figure 8-5 represents a rather complicated arrangement employing 
a sizable number of comparators in consideration of those usually available 
with a purely analog computer. It is becoming obvious that, as the optimi- 
zation problem grows in complexity, more sophisticated logic hardware will 
be necessary. An otherwise purely analog computer that possessed a reason- 
able number of logic-circuit elements, such as AND, OR, NOR, and NAND 
gates, would permit a much simpler configuration, With still increasing com- 
plication, such as an increase in the number of parameters to be optimized, 
actual digital-computer operations become desirable and the need for hybrid 
facilities becomes obvious if the speed advantages of analog computation 
(when establishing C for various values of «) are to be realized. 

In any event, the arrangement shown in Figure 8-5 will converge on 
a mathematical minimum cost function. If the C versus « relationship appears 
as in Figure 8-1, this solution will constitute the optimum. If, on the other 
hand, the relationship has more than one minimum, as in Figure 8-2, whether 
the minimum found corresponds to the extreme minimum and hence to the 
optimum will depend upon the initial value of « (i.e., 0%») that is introduced 
at the integrator producing the signal a. 

It would be possible to prepare a random-scan program that would 
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be applied prior to the operations shown in Figure 8-5; this would require 
the generation of a sequence of random values of «, With a purely analog 
machine, such a sequence could be produced by techniques discussed in 
Chapter 9. Additional comparators and track-hold circuits would then be 
required to store the lowest value of C that resulted and the corresponding 
a. With a sufficient number of such random values of « employed, it could 
be assumed that the value of finally being so stored would represent a 
Starting value for the procedure of Figure 8-5, so the minimum reached 
would be the true optimum. 

The above procedure is entirely feasible with a sufficiently extensive 
analog machine. However, it is becoming obvious that except for the simplest 
optimization problems hybrid facilities should be used if analog computation 
is to be employed during the trial runs. 


8-6 Optimization Technique with One Adjustable 
Parameter—Digital Means 


With digital simulation, or hybrid simulation where the computation of 
C as a function of « is performed by analog means but all other computa- 
tions are performed digitally, a different strategy is preferred. The procedure 
for finding the minimum then is as follows: 


1. An initial trial value of « first is specified; then the corresponding 
value of C is established. a is then increased by a specified increment 
Aw and the next value of C is computed. 

2. If the second value of @ results in a lower value of C than did the 
first, « continues to be increased by the increment Aw. On the other 
hand, if the second C is greater, the direction of change of a should 
be reversed. Therefore, the next increment will be —2Aa and, for 
subsequent increments, Aw is changed to minus its original value. 
In any event, the desired progression is toward lower and lower 
values of C. 

3. Eventually, if a minimum exists, C should at some time be observed 
to increase again as this progression of # is continued. As soon as 
this is observed to occur, a search is conducted for the minimum 
point. Let the interval at which this occurs be called the nth interval. 
Then C(n) > C(n — 1) and C(n — 1) < C(n — 2). This situation 
is illustrated in Figure 8-6. (This diagram is based on Aa being 
positive; however, the procedure is valid when it is negative as well.) 

In Figure 8-6, C(m) < C(n — 2); this is not always the case. 
In any event, from these three point a quadratic algebraic relation- 
ship between C and « may be established and the value of o where 
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C would be a minimum, jf such a relationship were valid, may be 
found. The algebra involved in establishing the increment necessary 
to arrive at this value of « is completely straightforward but some- 
what tedious and will not be included here. It results in the following 
suggested value of the next, mth, increment: 


1 [Aa(n — 1)P[AC(n — 2)] + [Aa(n — 2)?[AC(n — 1)] 
2 [Aa(n — 1)[AC(n — 2)] — [Aa(n — 2)[AC(n — 1] 


— Aa(n — 1) (8-8) 


4. a is increased by the increment proposed in the above relation 
(which will always be algebraically negative during the first try); 
that increment then is defined as Aa(n — 1) and the preceding incre- 
ment now becomes Aa(n — 2). C is evaluated again with this new 
a, The previous increment in C, AC(n — 1), is renamed AC(n — 2), 
and the new increment now resulting, AC(n — 1). Relation (8-8) 
is applied again for the increment in @ that is to follow. 

5. If the C versus « relationship were truly of a quadratic form, the 
increment of a obtained from relation (8-8) the second time it was 
applied would, theoretically, be zero and in practice (because of 
roundoff errors) would be very small. Hence the next time C is 
computed, AC(n — 1) would be practically zero. The minimum is 
assumed to be found when AC(n — 1) falls to within some specified 
tolerance range of C, tol,. 

As in general the relationship will not be quadratic, relation 
(8-8) will usually have to be applied more than twice before this 
tolerance is met and the minimum is found. 

6. In any practical situation there will be some constraints applied to 
the permissible range of a, designated as Om.x ANd Onin. If, while 
stepping along according to part 2 above, C is never observed to 
ascend before m,x OF ®min is reached, the minimum point (not a 
true mathematical minimum in the sense of there being zero slope) 
is assumed to exist there. 


Aa(n) 
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The above procedure can be handled as a subprogram, shown in flow- 
diagram form in Figure 8-7. All the common arguments of this subprogram 
have already been mentioned except for the integer and logical variables 
that are used. FINISH indicates that the minimum-has been found. MAXHOLD 
or MINHOLD indicates that the optimum lies at the @m,x OF min Value and is 
not a true mathematical minimum. TRIALS is the count of the number of 
search trials made plus the two necessary at the beginning of the program 
to assure the correct initial direction of progress of «; TRIALS is initialized 
as | in the calling program. MAXTRIALS is the maximum number of search 
trials permitted, to be named in the main program; when this number of 
trials must be exceeded to find the optimum, EXCESS is made true; this 
informs the main program of this event so that a corrective operation, or else 
a termination of operation, may be called for. 

The procedure shown in Figure 8-7 is self-explanatory for the most 
part. The computation of C with the suggested starting value of a before 
calling this subroutine for the first time normally would be the first trial. 
However, it is necessary, as the easiest way to prevent programming diffi- 
culties that could occur, to assure that this starting @ will lie at least 2Aa 
increments away from the 4x ANd mi, boundaries (and, naturally, between 
these boundaries). Therefore, during the first call with TRIALS = 1, a test 
is made to determine whether this is the case. If it is not, the value of a is 
reset to comply with this condition and TRIALS remains | so that the first 
initializing pass is repeated. In any event, once this requirement is met 
during either the initial or second pass the value of C is saved (as Cys), & 
is incremented the prescribed initial amount, and TRIALS is made equal 
to 2. 

After TRIALS becomes 2, it is observed whether a has been progressing 
in the proper direction (so that C will decrease). If this is not the case, the 
sign of Aw is reversed; a double negative increment of a is made just this 
one time; the first observed value of C is treated as the second and the second 
as the first [for the purpose of application of relation (8-8)]. 

From TRIALS = 3 on, @ is progressed at the same constant increment 
in the direction just established until C is observed to increase again. If before 
this happens @m,x OF Gin is reached, the value of C then resulting is con- 
sidered to be the minimum; LAST is made true; either MAXHOLD or 
MINHOLD is also made true. The value of « is then made equal to either 
%max OF min and the operation returned to the calling program for one last 
computation of C. The next time this subroutine is called, since LAST is 
true, FINISH will be made true and the final return to the calling program 
is made. 

Once C is observed to increase, SEARCH is made true. Relation (8-8) 
is applied repeatedly until the increment of C is within the tolerance range. 
Once it is, the value of « and C last established are considered to correspond 


376 Optimization of Simulated Systems Chap. 8 


SUBROUTINE MINIMA (C, tol, @, Aa, & max: @mins FINISH, MAXHOLD 
MINHOLD, TRIALS, MAXTRIALS, EXCESS) 


LOGICAL FINISH, MAXHOLD, MIN- INTEGER TRIALS 
HOLD, LAST, FORWARD, EXCESS, 
SEARCH 

=1 >2 


FINISH = false 
SEARCH = false =2 
MAXHOLD = false 


MINHOLD = false 
LAST = false 
EXCESS = false 


< = cz=¢ = 
> last 
at 2|Aa|Z an, 9 g C increasing; 
Cc reverse sign of 
decreasing Aor 


Aa(n — 2) = Aw 
AC(n — 1)=C—Cyy 
+ Aa 


Aa = —Aa 
Aa(n — 2) = Aa 
AC(n — 1)= Cy —C 
a=at 2.+Aa 


RETURN RETURN RETURN 


> < 
a—2lAal2=a,i, 


still step- 

ping with 

constant Aw 
RETURN 


FIGURE 8-7 
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if not at 
constraint 


RETURN 


start 
search have reached 
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FINISH = true 


continue 
search 


SEARCH = true 


continue RETURN 
stepping 
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found minimum maximum 
constraint? constraint? 


O Onin 


FINISH MINHOLD = true 


MAXHOLD =true 


RETURN 


FIGURE 8-7 (cont'd) 
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LAST = true 


RETURN 


TRIALS — 22 MAXTRIALS 
? 


maximum continue 
permitted stepping 
trials have with same 
occurred we 


RETURN 


SAVE = Aw save present Aa before modifying 


EXCESS = true 


RETURN 


relation (8-8) 
with Aa(n — 1) re- 
presented simply 
as Aa 


(Aa)? [AC(n = 2)] + [Aan = 2)? [40H —1)} _y 


ae 
Bax 9 [Aad [AC(n — 2)] — [Aa(n — 2)} [AC(n — 1)] 


Aa(n — 2) = SAVE 
a=a+ da 
Cust =C 
TRIALS = TRIALS + 1 


RETURN 


FIGURE 8-7 (cont'd) 


to the optimum condition and the search is terminated (FINISH = true). 
If before this occurs the maximum stipulated number of trials is made, 
EXCESS is made true and the search terminated. 

The modifications required so that the search would be for a maxi- 
mum rather than a minimum, as when a maximum figure of merit was being 
determined, is obvious. It is possible to use the above program for this 
simply by making C equal to —M (where M is the figure of merit). 

When there are a number of minimum points, which point is found 
is determined by the starting values of « and Aw. Even with the correct start- 
ing values of a, the extreme minimum could be missed if Aw were too large. 
Figure 8-8 shows how this could occur. Figure 8-9 shows how such a sub- 
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search will find 
this minimum 


SS 
a(1) (2) (3) 
FIGURE 8-8 


program could be employed in connection with a simulation program to 
find an optimum parameter a, 


8-7 Use of Random-Search Technique 
to Find Optimum Parameter 


Chapter 9 will discuss both analog and digital techniques for generating 
random variables. For the purpose of random search, usually a uniform 
probability density over the complete range of & from min tO &max is desired. 
This simply means that the probable frequency of occurrence of the vari- 
able in a given range, say Aa, is independent of the magnitude of «. How 
such uniform probability-density variables might be generated is also dis- 
cussed in the Chapter 9. 

Figure 8-10 shows an analog arrangement for effecting optimization 
by such a means. The source of random values of @, or a(t), would be adjusted 
to cover the range from min tO Gmax At the end of each trial the ratchet 
circuit holds a new value of a, or a(n). The resulting cost function C(”) is 
sampled by a second ratchet circuit, similarly actuated. Comparator 5 com- 
pares each C(n) with what has been established as C,,,; whenever C(n) is 
of a smaller magnitude than the present C,,,, this comparator becomes 
actuated and, by means of the ratchet circuit that it controls, C(n) becomes 
the new C,,,. At the same time, by another ratchet circuit controlled by 
the same comparator, a(n) becomes the new ,,,. Comparator 4 serves a 
function similar to that of Figure 8-5; it causes a(1) and C(1) to be tenta- 
tively accepted as the optimum values when the search procedure first starts. 

With a sufficient number of such trials, a reasonably close optimum 
might be found with the advantage, mentioned previously, that no confusion 
is caused by nonextreme minima. It is also possible to combine the arrange- 
ments of Figures 8-5 and 8-10 so that the random search just described will be 
conducted first and, when a sixth comparator indicates that sufficient time 
has elapsed (this comparator being actuated by a relatively slow timing inte- 
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FIGURE 8-10 


grator), the configuration is switched to that of Figure 8-5. The value of 5 
being held at the end of the random-search portion of the program would 
be used as the initial «, value applied as the initial condition to the integrator 
that develops the parameter «. 
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The procedure that would be used for effecting a random search by 
digital means is obvious. Either a user-provided or library subroutine would 
be employed to provide a new random number every time it was called. As 
mentioned earlier, this subroutine should be of the type that provides numbers 
with a uniform probability density. For example, this random source! 
might provide numbers in decimal form, from zero to 1. Suppose that the 
number provided between zero and 1 is a. The parameter @ could then be 
established as 


6 = Amin + A(Omax — %min) 


The problem then becomes simply that of saving the number pair, (#, C), 
and calling them o,,, and C,,, whenever the results of a given trial run 
provide a lower value of C than has been achieved previously. Again this 
method could be used as a starting technique for a limited number of trials, 


after which the program of Figure 8-7 might be employed. 


8-8 Method of Steepest Descent with More 
Than One Adjustable Parameter 


The general problem of optimization with more than one adjustable param- 
eter has been discussed in Section 8-3 and illustrated in Figure 8-4 (for the 
special case of there being two adjustable parameters). One method men- 
tioned, the method of steepest descent, was described by relation (8-6). 
Returning again to that relation, it is seen that the partial derivatives of the 
cost function with respect to each of the adjustable parameters must be 
established in order to reestablish, in turn, the direction of the next trial 
[Aa] vector. With the type of simulation problems we are concerned with 
here, this cannot be done analytically, only by means of test perturbations. 

It is possible to employ an analog computer that is equipped with a 
sufficient number of comparators and track-hold circuits to effect such a 
type of operation. However, this would be somewhat foolish unless there 
were no other hardware available; everything involved in such an opera- 
tion is essentially of a digital nature except for, possibly, the actual trial 
run of the analog model itself. Hence the type of program that might be 
used will be discussed here only in its digital version, it naturally being under- 
stood that if hybrid analog-digital facilities should be available, the trial 
runs might be conducted more effectively (and rapidly) by analog means. 
The method is based on trial iterations of | Aa|, where | Aa | is the magnitude 
of the [Aa] vector. When there are 1 parameters to be adjusted [i.e., «(1) 


1For example, the IBM Scientific Subroutine Package includes a subroutine, 
RANDU, that will furnish such numbers. 


Sec, 8-8 Method of Steepest Descent with More Than One Parameter 383 


|Aa| = /[Aa(1)}? + [Aa(2)}? + + 


= / Saar 


Two considerations are involved here: 


to a(n)], | Aaw| would be given by the relation 
(or 


(8-9) 


1. The relative values of each trial parameter change, Aa(i), must 
satisfy relation (8-6) so that progress will be exactly opposite to 
the direction of the gradient vector; that is, each Aa must have a 
relative magnitude that is proportional to the partial derivative 
relating it to the cost function 0C/da(i). 

2. The magnitude of the trial change in the parameters | Aaw| should 
be adjusted so as to converge upon the minimum value of the cost 
function C. The procedure used in Section 8-6, employing the 
subprogram shown in Figure 8-7 and called here SUBROUTINE 
MINIMA, is still useful for this purpose. 


The first of these considerations can be seen most readily in an example 
where the number of parameters to be varied, , is only two. The effect of 
a(1) and (2) on the cost function may then be pictured by means of contour 
maps, as was illustrated in Figure 8-4. Trial increments of | Ax| will appear 
simply as two-dimensional vectors on the (2) versus «(1) plane. The effect 
of complying with relation (8-6) is the maintenance of these vectors in a 
direction perpendicular to the contours and always in the direction of 
decreasing C. This procedure is analogous to that of a person lost in a fog 
who is attempting to find his way to the point of lowest elevation. As he can 
sense only the gradient (slope and direction of slope) of the ground in his 
immediate vicinity, his natural course is to always proceed in the direction 
of steepest descent. This procedure may not take him to the point of the 
extreme minimum of elevation, or optimum point, but it will take him to 
some minimum. 

This example may also be extended to cover the second consideration 
mentioned above, As the rate of change of the slope of the ground becomes 
less and less, the person involved would anticipate that he is reaching the 
minimum and would take progressively shorter steps, finally coming to halt 
when the minimum has been reached (and possibly deciding to engage in 
some sort of random search if he discovers that the minimum found is not 
his destination). The equivalent of this would be the procedure of minimi- 
zation discussed in Section 8-6. 

One difficulty that may be encountered when optimizing with respect 
to more than one adjustable parameter is caused by the possibility that the 
different parameters involved may have vastly different orders of magnitude. 
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\ 
Suppose, for example, that o(1) was a voltage of range from zero to 100 V, 
and «(2) a current of range from zero to 10-4 A. The magnitude of the vector 
change | Aw| would then be 


/ [Aad]? + [Aa(2)P 


but «(2) would have a negligible effect on the computation of | Aw| in spite 
of the possibility that, from a relative standpoint, «(2) might be the most 
significant factor in determining the cost function. If the roundoff error asso- 
ciated with digital computers is considered, the computation difficulties that 
could arise from such vastly different orders of magnitude of the «’s can 
be appreciated. (Here a scaling problem has arisen with digital computers, 
where, up to now, the impression may have been created that such problems 
arise only with analog computation.) 

A difficulty such as that mentioned can be handled by the obvious 
procedure of normalization. One convenient normalization technique consists 
of representing each a by a corresponding dimensionless £ defined as 


oy Oi) — Omin(Z) ¥ 

BO) = FAI) = Gail) — 
where Omax(i) and Oi,(/) are either constraints imposed on (i) or else the 
minimum and maximum values of the anticipated range. (i) would then 
vary in magnitude from zero to 1 as a varied from Omi, tO Omax- The mini- 
mization procedure would be carried out with respect to the normalized 
parameter value f. Steepest descent (i.e., the minimum gradient) would follow 
the relationship 


oc 
(1) 
dc 


ABQ) 5 
rr eens eer (8-11) 


ABU) 


where k is a constant selected so that the magnitude of [Af], or |Af| will 
be of the size desired. This constant will be 


k= — 148 (812) 
y Ylaciepar 
| 4B], in turn, may be established by the minimum-seeking program of the 


type discussed in Section 8-6 and employing the interpolating relationship 
of relation (8-8). 
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This minimization procedure may also be complicated by the con- 
sideration of the constraints «,,,;(/) and 0,;,(/) imposed on some of the adjust- 
able parameters. In terms of the f’s these constraints may be expressed 
simply as 

0< fi)<1 (8-13) 
as far as the normalized parameters are concerned. Therefore, when estab- 
lishing each trial increment of f, it will be necessary to observe whether 
the above limits are being violated. Suppose that when a given increment 
|AB| is applied, the limits constraining the jth parameter do turn out to 
be violated. It will then be necessary to reduce the magnitude of | Af| so 
that the boundary at B(j) = 0 or at B(j) = | is just reached. During future 
increments |Af|, the particular value of f(j) that would be called for by 
relation (8-11) is observed. If the sign of this is such as to penetrate the 
boundary [ie., AB(j) > 0 when f(j) = 1, or AB(j) <0 when f(j) = 0), 
then the increment Af(/) is not applied, but the other, unconstrained param- 
eters are incremented in such a way that the proposed magnitude of |AP| 
is maintained. Of course, if all parameters become so constrained, the mini- 
mum (not the true mathematical minimum since the gradient is not zero) 
will be considered to have been reached. If, however, during any subsequent 
iterations it develops that the change in B(j) recommended by relation (8-11) 
should tend to move its value away from the boundary into the unconstrained 
region, the constraint again is removed and f(j) is again progressively 
adjusted during the optimizing process. 

The procedure discussed above is illustrated by Figure 8-11 for the 
example of two adjustable parameters, a(1) and (2), which are represented 
here by their normalized values, #(1) and #(2). The proposed starting values 


numbers on 
contours cor- 
respond to 
values of cost 
function, C 


B(1) 


BO) =1 
FIGURE 8-11 
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of a(1) and «(2) are converted to their corresponding normalized values, 
B() and (2). In Figure 8-11 this corresponds to starting point A The 
steepest-descent approach involves progressing in a direction normal to the 
contours and in a sense to decrease C, until finally, at point B, the maximum 
value of A(1), or unity, is encountered. A(1) is then held at unity; only 
B(2) is changed and the progress is in the direction shown until point C, 
where it is observed that again progressing in the steepest-gradient direction 
would cause the operating point to leave the B(1) = 1 boundary. The A(1) 
constraint is no longer applied and progress again continues perpendicular 
to the contours until, at D, the constraint at B(2) = 1 is reached. f(2) is then 
held constant and only A(1) is varied until the optimum point EZ is reached. 
E represents the true optimum in consideration of the (2)... constraint. 
Had it not been imposed, point P would, of course, have represented the 
optimum conditions. 

From Figure 8-11 it is obvious that the shortest route was not taken. 
However, as with the analogy of the man lost in a fog who is attempting 
to find the point of lowest elevation, the procedure followed here is one of 
the most effective ones when the cost function can be found only by trial- 
and-error simulation runs. 

A parameter constraint should not cause the type of limiting described 
here unless it represents a true physical constraint. Some parameters will 
not be constrained at all, in a practical sense. True, their physical manifes- 
tation must have some reasonable maximum and minimum values, but 
these may be far removed from the range of values within which these param- 
eters would normally be adjusted. In such instances O,, aNd Opin are 
specified only to provide a basis for normalization; they should be established 
at sufficiently high and sufficiently low values so that these constraints are 
never reached during the optimizing search procedure. 

The program for employing the method of steepest descent is compli- 
cated mostly by the constraints placed on the «’s; without these it would 
be fairly simple. It will be explained first as though there were no constraints 
to be considered. 

The tolerance imposed to establish when the minimum C has been 
reached, the starting value of each a, the maximum and minimum values 
of each @, the initialization of the count of trials, and the number of adjust- 
able parameters involved are all in common with the main program and 
are established by it. Also specified there are the initial values of the first 
increments, the Aa(i)’s, expressed in normalized form as AB,..,, and appli- 
cable to all of the Af(i)’s during the first trial increment. A typical starting 
value for AB... might be 0.05, The corresponding vector length for this 
first increment would be |Af| = ABs ./NPARAM, where NPARAM is the 
number of adjustable parameters involved. 
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A very considerable amount of research has been done on the opti- 
mum method for determining step size and for determining when the opti- 
mum has been found when the steepest-descent technique is employed. 
From this no conclusions can be drawn as to which are the best methods. 
Ones that prove superior for one type of C versus [a] relationship may fail 
completely with other types. One method is to keep the step size (as mea- 
sured by the length of the vector, | Af|) constant until C again is observed 
to increase. Whenever this occurs, | AB| is multiplied by a reduction factor 
k,. As a result, there will be progressively smaller and smaller increments 
taken as the optimum is approached. Some trial-and-error procedure may 
be required to establish the best size of this reduction factor; values between 
0.5 and 0.8 have been found successful in practice, the lower values provid- 
ing a slower and more cautions approach to the minimum (and also a greater 
possibility of a computer underflow as |Af| becomes too small). 

The determination of when the optimum has been found is done by 
means of the specified tolerance, tol,. This tolerance is applied to the magni- 
tude of the change of C during a given increment. It should be noted that 
the meeting of this tolerance merely once is no indication whatsoever that 
the optimum has been found. This is illustrated in Figure 8-12 for the special 
case of one adjustable parameter. This tolerance must be met twice in a 
row; after it has been met the first time the increment size is halved. As a 
result, as Figure 8-13 shows, the tolerance normally would not be met the 
second time if a true minimum had not been encountered. 


(63 tol, 


so program decides 
that the optimum 


has not been found 


|C@ +2) -C(n+1)| € tol, 


|C(n + 1) — C(n)| 
<tol, 


a(n) a(n+2)a(n+ 1) 
FIGURE 8-12 


This simplified approach of using a tolerance imposed on C as a crite- 
rion may be criticized in that it will not locate the optimum parameters very 
precisely when the minimum is a very flat one. The answer to this argument 
would be simply that the precise location of the parameters becomes less 
and less important as the minimum becomes flatter and flatter. 
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8-9 Relaxation Method for Finding the Optimum 
Parameters 


Properly speaking, the relaxation method consists of determining at the 
start the steepest-descent direction, and then continuously varying all param- 
eters without changing that direction until a minimum has been found. 
The new steepest-descent direction is then determined and the process is 
repeated, This is continued until the criterion for establishing the optimum 
has been met. 

Almost as effective is the method to be discussed here, often called 
the modified relaxation method. (As there is no official terminology, this is 
only one of several methods so designated.) It was discussed in Section 8-4 
and consists of varying each parameter in turn. As far as required execution 
time is concerned, it often proves more effective than the relaxation method 
because the much simpler programming and computation involved compen- 
sate for the increased number of steps that may be required for convergence. 

Figure 8-13 illustrates how this method might operate for the special 
case of there being two adjustable parameters. It portrays the same type 
of contour map as was shown in Figure 8-11, where the steepest-gradient 
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approach was illustrated. There is no need for normalization of parameters; 
hence, the axes are labeled directly in terms of the «’s. The solid-line paths 
show the path that would be traveled with the @,,,, constraints imposed. 
Starting at point A, (1) is varied first until «(1),....is encountered at point B. 
«(2) is then varied until «(2),,,, is encountered at point C, o(1) is varied again 
until the minimum (in consideration of the constraints) is found. 

The dotted-line path illustrates the path that would be followed had 
there been no maximum constraints on the @’s. The first search ends at B’, 
then successively at C’, D’, E’, to F’ where the optimum is found. 

The program for optimization using this relaxation method is simpler 
than that of the steepest-descent method as the gradient need not be evaluated 
at every step, and since at any time optimization is being performed with 
respect to only one parameter, SUBROUTINE MINIMA, described in Sec- 
tion 8-6 and shown in flow-diagram form in Figure 8-7, may be employed. 
Still, it is complicated somewhat by the necessity of considering constraints. 

Figure 8-14 is a flow diagram for this relaxation-method subprogram. 
It is mostly self-explanatory. One complete series of optimization operations 
with each of the NPARAM parameters is called a ROUND. ROUNDS are counted, 
and some limit, MAXROUNDS, is imposed so that the program does not run 
indefinitely should it fail to find the optimum within a reasonable execution 
time. MAXTRIALS is also specified to limit the permissible number of search 
trials each time the subroutine MINIMA is called. A tolerance, tol,, is imposed 
as usual to decide when the subroutine MINIMA has found the local mini- 
mum (on the basis of varying only one parameter); this is explained in 
Section 8-6. When the difference between the minima found at the end of 
each trial for each parameter is less than tol, for NPARAM successive trials, 
it is then decided that the optimum has been found. NCONVERGE is the 
variable that counts the number of successful trials to apply this criterion. 

The actual operation of the program is simple to explain if the con- 
straints first are not considered. The single adjustable parameter of 
SUBROUTINE MINIMA, called w in that program, is in common with 
the variable called A here. This is set equal to the value of « for the param- 
eter being adjusted [i.e., to «(1) at the very start]. Also, at the start, the 
starting Aw’s are all proportioned by the single variable established in the 
main program, called Af,,,,,. For the ith parameter this would be 


Aa(i) = ABstaril%max(?) — %min(i)] 


This initialization is done by SUBROUTINE RELAX when ROUNDS = 0. 
At this time also, all logical variables involved initially are set to false. 
Further initialization is then performed with regard to the particular param- 
eter to be next adjusted [i.e., to i= 1 at the very start]. Then, this first 
time only (because START is true), SUBROUTINE MINIMA is called at this 
point to start the minimization procedure on the basis of the value of C 
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SUBROUTINE RELAX (C, tol ¢, o, AB, © max » &min, ROUNDS, MAXROUNDS, 
NPARAM, FINISH, EXCESSIVEROUNDS, FAIL, ALLHOLD, MAXTRIALS, EXCESS) 


LOGICAL FINISH, FAIL, ALLHOLD 
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yy, MAXHOLD, 
ISTTRY 
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FIGURE 8-14 
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FIGURE 8-14 (cont'd) 
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RETURN 
(trials are 
being con- 
tinued for 
agiven 
parameter ) 


did last try 
also result 
in excessive 
trials? 


EXCESS ISTTRY (i) 
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FINISH = true 


try next 
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(failed to find 
minimum without 
excessive trials 
twice in row for 
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FIGURE 8-14 (cont'd) 
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ously con- 


strained, 


make MAXHOLD 
or MINHOLD 


false 


true 


true 


MAXHOLD(i) 
9 


now check for 
constraint at 


false 


false 


false 


SUBMAXHOLD true 
1 


false 


MAXHOLD(i) = true 


now constrained 
tO Qin + WAS 
this parameter 
previously con- 
strained? 


MINHOLD (i) = true 


MAXHOLD(i) 
i 


now constrained to 
Onax; Previously 


constrained? 


true 


yes; Do 
not add 
to count 
of 
NHOLD 


NHOLD + 1 


are all parameters 
now constrained? 


FIGURE 8-14 (cont'd) 
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FIGURE 8-14 (cont'd) 
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EXCESSIVEROUNDS = true 
FAIL = true 
FINISH = true 


start with 


a (1) again 


RETURN 


return to minimize with 
this next parameter 


FIGURE 8-14 (cont'd) 


already computed for the first trial values of the «’s. When the return is made 
from SUBROUTINE MINIMA, which provides the new suggested value of 
a(1) as the variable, A, as SUBEXCESS (in common with EXCESS in 
MINIMA) and SUBFINISH (in common with FINISH in MINIMA) will not 
be true, this relaxation subroutine simply will set «(1) equal to A and then 
return to the main program for another trial computation of C. When 
RELAX is called again, and during all future calls, MINIMA will immediately 
be called in turn. This process continues until either SUBFINISH or SUBEX- 
CESS becomes true. 

If MINIMA should make SUBFINISH true, meaning it has found the 
minimum successfully, any previous record of excessive trials with this 
parameter is erased (EXCESSISTTRY is made false) and a check is made 
to see whether the change in C resulting from this parameter adjustment is 
within the tolerance. If it is, the count of convergences, NCONVERGE, has 
one added to it. If it is not, NCONVERGE is reset to zero as these successful 
trials must be consecutive. 

On the other hand, if MINIMA should instead make SUBEXCESS 
true, a check is made to establish whether the condition of excessive trials 
happened also during the preceding adjustment of this parameter. If it did, 
the optimization task is considered to have failed; FAIL and FINISH are 
made true and the integer EXCESS is set equal to i to identify the parameter 
involved in the difficulty. If this was the first failure (EXCESSISTTRY is 
false), another chance is given; EXCESSISTTRY is set to true and the opera- 
tion proceeds with minimization with respect to the next parameter. 

At the start of minimization with the next parameter, the value of C 
applying prior to the adjustment is saved as C,,,,. Then the proposed values 
of « and Aw, established as A and AA, are set into the values of a(i) and 
Aa(i). Finally, i is moved up one so that the next parameter will be adjusted. 
The operation then returns to the beginning of the subroutine where re- 
initialization again takes place for the adjustment of the next parameter. 
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Note then that operation returns directly to the main program so that C 
can be computed before again calling MINIMA. 

It should be noted that when 7 exceeds NPARAM after the operation, 
then i= i+ 1; this indicates that a round has been completed. Hence, the 
number of ROUNDS has one added to it. A check is made to see if the speci- 
fied maximum number of rounds has been exceeded. If it has, the program 
is considered to have failed; EXCESSIVEROUNDS, FAIL, and FINISH 
are all made true and the operation terminated, Otherwise, 7 is reset equal to 
1 so that (1) will again be adjusted—the start of a new round. 

As has been mentioned, every successful convergence upgrades 
NCONVERGE by one; these must be consecutive. When NCONVERGE becomes 
equal to NPARAM, the optimum is assumed to have been found, FINISH 
is made true. Note that because of this criterion of successive convergences 
all satisfying tol,, the actual precision of computation of the optimum will 
ordinarily be much finer than the amount specified by this tolerance range. 

Now the complicating factor of considering constraints should be 
discussed. The engagement of a constraint is first noted by MINIMA, which 
makes either SUBMAXHOLD or SUBMINHOLD true. If either are, then either 
MAXHOLD(i) or MINHOLD(i ) is correspondingly made true, and NHOLD 
is upgraded by one. If all parameters should become constrained, this is the 
end of the optimization procedure; ALLHOLD and FINISH are made true 
and a return is made to the main program. Otherwise, operation continues 
with adjustment of the next parameter. 

If, on the other hand, a parameter just adjusted is found to have not 
engaged a constraint, a check is made to establish whether it previously had 
been constrained. If it had been, that constraint indication, MAXHOLD( i ) 
or MINHOLD( i ), is made false, and NHOLD downgraded by one. Note that 
a constrained parameter still is retested each round; SUBROUTINE 
MINIMA will automatically commence the test two Aa increments away 
from the constraint bound. 

Figure 8-15 is a general flow diagram of a program that would call 
this SUBROUTINE RELAX. Since most initialization takes place within the 
subroutine itself, only a few initialization operations are required here. The 
starting «’s, the values of &,,, aNd Om, for each w, and the proportion of 
initial increment Af,..;, must all be established in the calling program, 
The logical variables FINISH, FAIL, EXCESSIVEROUNDS, and 
ALLHOLD inform the calling program of the status once operation is ter- 
minated; the calling program may take different recourses as a result, 
depending on the application. 
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recourse parameters 


FIGURE 8-15 
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8-10 Analog Method for Applying the Relaxation 
Technique 


The relaxation method of optimization is more adaptable to analog com- 
putation than is the steepest-descent approach. When using digital means, 
such as SUBROUTINE RELAX, most of the actual work of optimization was 
done by SUBROUTINE MINIMA. The analog arrangement shown in Figure 
8-5 is the equivalent of MINIMA and may be similarly employed. The major 
modification of the program shown there involves the input and control 
of the integrator that develops the parameter a. Track-and-hold circuits 
are required that will hold each value of as the others are being adjusted. 
When its turn comes, this value of a is applied to this integrator as a new 
initial condition. The integrator output is reconnected to the appropriate 
input terminal of the analog of the process being optimized. 

The switching operations described above could all be accomplished 
by means of comparators. The duration of time that optimization is allowed 
to take place with respect to each parameter during each round could also 
be specified and controlled by a timing integrator and comparator. This is 
equivalent to specifying MAXTRIALS with the digital approach, Another 
method might consist of switching to the adjustment of the next parameter 
when | &| becomes sufficiently small. All these operations would be expedited, 
of course, by the availability of hybrid facilities. 

With such analog optimization schemes, scaling of the parameters 
is, of course, necessary. It should be noted that this is similar to conversion 
of the parameters to the normalized # parameters represented by relation 
(8-10). 


8-11 Optimization with More General Constraints 


The only constraints discussed thus far have been maximum and minimum 
constraints applied to each parameter. The more general situation will 
involve constraints of the form 


Sa), «(2), ... a(n)] < HC) 


or 


A(Ha(1), (2), .. - , H(n)] > Lj) 
or possibly both. This is the situation in what are called programming prob- 
lems in operations research. If f(/) is a linear function, then the problem 
is described as being one in /inear programming; otherwise it is called non- 
linear programming. 
A general approach to all such programming problems is beyond the 
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intended scope of this chapter. (After all, many books have been devoted 
to this one subject.) However, one approach is suggested here that is appli- 
cable to most of the cases that arise in practice. It is illustrated best by 
example. 


Example of a Nonlinear Constraint. Suppose that there are only two adjust- 
able parameters, a(1) and «(2); three constraint variables, f(1), f(2), and 
J (3); and five constraints: 


F(aC1), oe(2)] = (1) 

S(2)fae(1), oe(2)] = (2) 

SBY[aC1), (2)] = (1)? + 200(2)* 
O<fQI)<1 or fin =O  f()max = 1 
O<fQZ<! or fQnin=0 f2)mx = 1 

£3) <1 or fQ)mx = 1 


These constraints plot on the «(2) versus (1) plane as shown in Figure 
8-16. It is obvious from the diagram that the f(1)m.x, and f(2)m,, constraints 


7 


a 
eS [a(1), @(2)] permitted 
= only in unshaded region 


(2) 


FIGURE 8-16 


play no role. To be able to use such optimization techniques as RELAX, 
theses constraints must be converted to constraints of the maximum and 
minimum type only. It would first occur that this might be accomplished 
by optimizing with respect to the adjustable parameter o(1) and with respect 
to f(3), considered as though it, also, was an adjustable parameter. After 
the optimum a(1) and /(3) have been found, the corresponding value of 
a(2) may be readily determined. The constraints would be expressed as 


AV min =O @(Vmax = 1 f3)min = 9 f(3)max = | 
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The constraint o(1)max is a completely artificial one and is used only because 
the optimizing subroutines require some indication of all maximum and 
minimum values of the parameters. Still referring to the «(2) versus a(1) 
plane, these constraints would now appear as shown in Figure 8-17. It 
should be noted that the constraint corresponding to «(2),,;, has been lost 
and parameter adjustment is permitted anywhere in the unshaded portion of 
the «(2) versus (1) plane; an additional unwanted quarter-circle has been 
added to the allowable region. 


a(2) 


Yi 


ae 


} WMA 


Y 


y 
-1/V2p 


a(1) 


7 


FIGURE 8-17 


This modification of constraints will cause no problem provided it is 
assured that no minimum exists in this region of negative «(2). If one does, 
an additional obvious parameter modification is necessary: 


feANa(1), (2)] = tan-* 582) 


with the maximum and minimum limits 
fOmx=F — fAnin = 0 


Minimization would then take place as though (3) and f(4) were the 
parameters with the limits as described. Whenever the optimization sub- 
routine returned to the calling program for evaluation of C, this program 
would be required to compute (1) and a(2) from the values of f(3) and 
{(4) proposed by the subroutine, and then, in turn, compute C. For the 
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example here, the computation of the a’s from the /’s is simply 


a(1) = f(3) cos f(4) 
(2) = rf) sin F(A) 


The example above involved constraint functions, f(3) and /(4), 
that were expressible in algebraic-trigonometric form; furthermore, the 
inverse operations for obtaining the «’s from the /’s were also so expressible. 
Not all constraint relations are of this type; some may consist simply of a 
list of tabulated values of the f’s versus the ’s with the implication that 
interpolation is to be used between such values. Even such constraints could 
be handled by the method suggested. Given the values of the f’s, the values 
of the «’s could be obtained by means of the SIMULTANEOUS subroutine 
described in Chapter 5. This approach would, of course, consume more 
execution time than when the method could be performed by means of simple 
algebraic-trigonometric relations, as in the example above. 


8-12 Random-Search Optimization 
with More than One Parameter 


Whenever there is a suspicion that nonextreme minima may result in a 
solution at a false optimum, an initial random-search optimization proce- 
dure should be employed first to assure that the starting values of the param- 
eters for subroutine RELAX will arrive at the true optimum. Section 8-7 
discussed this for the case of there being only one adjustable parameter. 
The method with more than one adjustable parameter is essentially the 
same except that, instead of calling for just one random value to establish 
a parameter for each trial, n such random values must be called for each 
trial, where n is the number of parameters to be adjusted. 


8-13 Optimization of Configuration—Dynamic 
Programming 


Optimization has been handled here from a very restrictive viewpoint, which 
is, however, the simplest viewpoint to consider first. It is assumed that the 
tules that determine the cost function have already been established and 
that nothing remains except the choosing of optimum values of various 
constants (i.e., parameters) involved in this relation. 

Optimization in the broader sense involves optimization of configura- 
tion (e.g., configuration of the block diagram describing a system) or optimal 
strategy. Three general techniques (all basically related) have been proposed 
for this purpose: 
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1, Techniques based upon the calculus of variations. 
2. Use of the maximum principle proposed by Pontryagin [3]. 
3. Dynamic programming, as first proposed by Bellman [4]. 


Of the three methods, dynamic programming appears to be most 
adapted to computer optimization. A discussion of this technique, however, 
would be beyond the intended scope of this book, but the reader certainly 
is encouraged to pursue this field further as a logical extension of what was 
treated here. 


Suggested Problems 


8-1. Figure P8-1 is the block diagram of a very simple control system. K, 
is to be selected to meet the criterion that, for r being the step function 
indicated, of magnitude r,,, the following cost function will be minimized: 


C= erat 


To make this problem more general it is suggested that time be normalized; 
ue. 


t 


t= dimensionless time 


ae 
A=Ts= ré dimensionless operator 
“u=K,K,T dimensionless gain 


The problem then becomes one of finding the optimum y. (This problem 
does have a not too difficult analytic solution.) Find the optimum yz by 


either analog or digital means. 
ee 
s(1 + Ts)? 


© controlled 
output 


control 
force 


reference 
input 


FIGURE P8-1 


8-2. Repeat Problem 8-1 for the following definitions of the cost function: 
(a) C= fi jeldt 


(b) C= f (lel + K,TIm) de =f" (1+ wlelde 
(A penalty is now imposed for excessive control force, m.) 
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8-3. Repeat Problem 8-1 with the original cost criterion but with a limiter 
added to the configuration as in Figure P8-3. That is, 


a for —m,<a<m, 
m= 4m, for a>m, 
—m, for a<-—m, 


Find the optimum y as a function of the normalized ratio K,7m,/r,,. 


controlled 
output 


r= ry u(t) 


control 
force 


reference 
input 


s(1 + Ts)? 


limiter 


FIGURE P8-3 


8-4.? Four hundred cubic yards of gravel are to be moved across a river. 
It is to be shipped in one open box, making as many round trips as neces- 
sary. The box dimensions will be length a(1), width a(2), and height a(3). 
The sides and bottom of the box will be made of material costing $10 
per square yard; the ends of material costing $20 per square yard. The box 
will have no salvage value when the job is done. Each round trip across the 
river will cost 10 cents. 

With no constraints imposed on any of the dimensions, use a general 
computer technique (analog or digital) to determine the values of the a’s 
that will minimize cost. 


8-5. Problem 8-4 is to be modified by the addition of one constraint. 
The length a(1) is to be limited to a maximum value of 1.5 yards. Now find 
the optimum dimensions. 


8-6. Problem 8-4 again is considered but now modified by the constraint 
that the maximum diametrical length, i.e., 


/a(l)? + a(2)? + a(3)* 
is to be 1.5 yards. Now find the optimum dimensions. 


8-7. The control system of Problem 8-1 is now modified so that the con- 
troller, previously designated simply by the transfer constant K,, now 
becomes 


K 14+ T,s 
T= OTs 


2From R & D Letter, April-May 1964, Westinghouse Electric Co., Technical Infor- 
mation Dept. 
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Use a computer optimization method to find the optimum K, and T, in 
terms of normalized expressions for these parameters, w and £ = T,/T. 
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Simulation of Random 9 
Disturbances and Their Effects 


9-1 Circumstances Giving Rise 
to Random Disturbances 


It is more likely that systems being simulated will be subjected to distur- 
bances (i.e., independent variables affecting the response) that are of a 
random nature than to those of a deterministic nature. A deterministic 
function is one whose value can be defined at any instant of time.! Examples 
are classical transient forms such as step functions, ramps, exponential 
functions, and classical steady-state (stationary) forms such as sinusoidal 
functions. For example, the characteristics of communications systems are 
generally described in terms of the response to sinusoidal disturbances (e.g., 
the frequency response). In practice the disturbances likely to be applied 
to such systems are more likely to be of a random nature, with regard to 
both the useful signal being transmitted and the noise. 

Other examples of random disturbances that may be important in 
certain systems are the variation of outdoor wind velocity, the surface height 
of the water at a given point on a rough sea, the outdoor temperature at 
a given location, the degree of daily activity of trading in the N.Y. Stock 


1In this chapter it will be assumed that time is the basic independent variable; when 
the word “time” is used, it actually implies the basic independent variable involved in the 


simulation problem, whatever that might be. 
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Exchange, etc. In each of these instances the instantaneous values of the 
disturbance will not be predictable. The simplest qualitative definition of 
a random disturbance is simply that it is a disturbance that is not deter- 
ministic. This is not, of course, a rigorous mathematical definition of a 
random disturbance, but it should suffice for the purposes here. It will be 
assumed that the reader does have some other background in this subject. 
In any event, much more rigorous and hence much more lengthy definitions 
of a random variable and related definitions are given in a number of text- 
books on this subject. 

From the examples given above it may appear that natural phenomena 
generally lead to random forms of disturbances. This is not always the case. 
As an example, the angular elevation of the sun above the horizon repre- 
sents a function of time that is deterministic, at least within the time of obser- 
vation of interest to us. Other random disturbances may not be completely 
random in nature. As an example of this, the outside air temperature at a 
given location will prove to have an annual periodic cycle, which is essen- 
tially deterministic, superposed on the random fluctuations, and, in addi- 
tion, a shorter diurnal cycle. One of the functions often assigned to computers 
is the separation of the deterministic portion of a disturbance from the 
purely random part. 

It will require little imagination to see how random disturbances 
might arise in practical situations. Mechanical structures are subject to 
random forces resulting from wind velocities. Airborne and seaborne vehicles 
are subject to random disturbances caused by sea turbulence. Chemical 
processes may be subject to random variations of the properties of the 
entering constituents. The random nature of the forces acting on an economic 
or biological system is obvious. 

Fortunately, in spite of the uncertain nature of a random disturbance 
at any given instant of time, it is possible to describe such disturbances from 
a statistical standpoint. It is possible to describe, quantitatively, the size 
of a random disturbance. For example, the height of random sea waves 
on a calm day naturally is generally less than on a rough day; this fact can 
be expressed in quantitative as well as qualitative form. The manner of time 
variation of a random disturbance can also be described quantitatively. As 
an example, the random variation of outdoor air temperature above the 
surface of the ground is known to be not only larger but also faster than 
the temperature 3 ft below the surface of the ground. This difference in rate 
of variation may also be described in a quantitative sense. Fortunately, 
there are methods available for describing the general statistical nature of 
random disturbances so that it will be possible to represent them reasonably 
faithfully in a simulation problem. 


Sec. 9-3 Describing the Magnitude of Stationary Disturbances 407 


9-2 Stationary Random Disturbances 


The types of disturbances to be discussed in this chapter will be confined to 
those described as either stationary or semistationary. Again, a rigorous 
definition of these terms would require more space than is practical in this 
book. It will suffice to describe a stationary disturbance as one whose sta- 
tistical properties do not change with time. For example, the instantaneous 
wave height in a disturbed sea might be considered as a stationary random 
variable if the wind remains steady and the sea state does not change. On 
the other hand, if the wind velocity was continuously increasing, giving rise 
to a progressively rougher sea state, the wave height could no longer be 
represented as a stationary random variable. In practice many random 
variables may be considered as stationary for only limited durations of time. 
They may be mathematically represented as stationary within a reasonable 
degree of approximation if the variation in statistical properties is minor 
during the time of interest and during the statistical averaging time (to be 
described later), 

Random disturbances may be described, loosely, as semistationary as 
well. These simply are stationary disturbances that are “turned on” at t = 0 
(ie., they are mathematically represented as the product of a stationary 
disturbance and a unit step function). 

The analytic treatment of nonstationary disturbances is, in general, 
much more difficult and will not be discussed here. However, it will be 
obvious to the reader how simple cases of such nonstationary disturbances, 
such as a noise signal having statistical properties that are uniform except 
for a slowly but uniformly increasing intensity, might be handled for simu- 
lation purposes. 


9-3 Describing the Magnitude of Stationary 
Disturbances—Probability Density 


If there is no concern regarding the manner of time variation, the amplitude 
characteristics of a random variable can be described by its probability 
density. Most readers undoubtedly are already familiar with this concept, 
but, for purposes of review, it is expressed here when applying to a random 
variable x(t) as 


f(x) lim Pex < xp < Eda Ax} (9-1) 
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In the above expression the symbol P represents the probability of the 
event described in the braces that follow. In this application it is implied 
to mean the probability that x(¢) meets the inequality condition stated when 
t is randomly selected. (Again a more precise definition would be required 
for complete mathematical rigor.) 

When x(t) is a stationary random variable, the probability of the event 
referred to above may be reexpressed as 


P(x < x(t) <x + Ax} = lim [Ss] (9-2) 


where f,(x) is the duration of time that the event {x < x(t) < x + Ax} is 
satisfied during a given test measurement of the random variable, of dura- 
tion T. 

Relation (9-2) indicates that this time-averaging method for deter- 
mining the probability P becomes valid only as T approaches infinity. In 
practice, if a running record of the ratio expressed by relation (9-2) were 
kept with T finite and increasing, it would be found that as T became suffi- 
ciently long, relation (9-2) would be fulfilled to a reasonable degree of 
approximation. This ratio would approach a constant value with eventually 
only minor fluctuations about this value during such a measurement pro- 
cedure. 

Relations (9-1) and (9-2) suggest methods for measuring the probability 
density by computer means. An analog technique for doing this is shown 
in Figure 9-1. The integrator shown that produces the signal V, measures 
the elapsed time of the test run. If the associated potentiometer setting is 
k,, this time will be limited to T= V,/k, sec because of the time-limiting 
comparator. When this time has elapsed, both integrators will be placed 
in a hold mode. The other integrator, producing the signal V,,, measures 
t, [i.e., the duration of time that x(t) is within the prescribed limits]. Hence 
Vin = kt, and 


ty — Vialky _ kp Vin . 
P(x < x(t) <x + Ax}= Vike kV. (9-3) 
Relation (9-3) is approximate in the sense that T necessarily must be finite. 
Substituting (9-3) in (9-1) yields the result, 


KVin 


fo) = re (9-4) 


Relation (9-4) is approximate, not only because T is finite but also because 
Ax necessarily must be finite rather than infinitesimal. As a result, a granu- 
lated relation for f(x) will be obtained. 
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time-limiting 
comparator V- 


FIGURE 9-1 


9-4 Classical Forms of the Probability- Density 
Function 


There are a number of classical forms of the function f(x) that appear 
frequently when dealing with natural phenomena. A few of these that might 
be encountered will be mentioned here. 

If x(t) should happen to have a finite probability of acquiring a specific 
discrete value of x, say x,, then f(x) will include an impulse function (Dirac 
function) as shown in Figure 9-2. Of course, measurements made as des- 
cribed on such a random disturbance, with a necessarily finite Ax, would 
appear as a large pulse of finite magnitude rather than as an actual impulse. 


410 Simulation of Random Disturbances and Their Effects Chap. 9 


f(x) 


P5(x — xq), where P = P{x = x,} 


FIGURE 9-2 


In many instances f(x) will be a constant within some specified range 
of x between x = x, and x = x, (x, > x,). That is, P{x < x(t) < x + Ax} 
is constant for a given Ax, provided that x, < x and x + Ax < x,. This 
is called a uniform probability density; a plot of f(x) versus x would then 
appear as in Figure 9-3, where it should be noted that the magnitude of 


f(x) 


FIGURE 9-3 


f(x) between x = x, and x = x, is given as 1/(x, — x,). This must neces- 
sarily be the case since 


fo, $0) dx = P-x,< xt) < thie = 1 (9-5) 


As the above probability represents the probability of x(t) having some 
value between minus and plus infinity, this must certainly represent a cer- 
tainty and the probability must be unity. Relation (9-5) applies to any 
probability-density function. 

One very common classical form of probability-density function is 
the normal or Gaussian form, where 


fa=qi-eol-4252)] 


Ea 


The general shape of this function is shown, when plotted versus x, in Figure 
9-4, The quantity o, is called the mean deviation; the quantity x, the mean 
value, the expected value, or the average value of x(t). 
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A basic theorem of statistics, the central-limit theorem, shows that if a 
large number of random variables arising from independent sources are added, 
the result will approach a random variable having such a normal or Gaussian 
probability distribution as the number of sources becomes increasingly large. 
In practice it will be found that even if a relatively small number, say 10, of 
such independent random variables are added, the probability density of 
the resulting sum will bear a surprisingly close resemblance to the normal 
form. This fact explains why the normal density function is so often en- 
countered with random disturbances arising in nature. Such disturbances 
usually represent the net effect of many independent random disturbances 
(e.g., Brownian motion, thermal noise, air turbulence). Hence the distur- 
bances to be simulated in many practical simulation problems will be of 
a normal or Gaussian form. 

There are a number of other classical forms of probability-density 
functions encountered often in simulation problems. Among them are the 
Poisson and binomial density functions applying to random variables that 
may partake of only discrete values, and also the gamma, beta, Laplace, 
Cauchy, Rayleigh, and Maxwell forms, These are discussed in many text- 
books that deal with random variables in more detail [1]. 


9-5 Digital Measurement of the Probability Density 


The digital program to determine the value of f(x) for some given digital 
record of a random disturbance is reasonably simple. It is assumed that there 
is some portion of the program producing the random signal x(t) in a sequen- 
tial fashion. The main program then would simply call a subprogram, called 
here PROBDENSITY, every time a new value of x(t) was produced. The 
features that would be added to such a main program for this purpose are 
shown in Figure 9-5. 

At the beginning of the program, the logical variables START and 
FINISH are made true and false, respectively. The maximum and mini- 
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logical variables 
directing subprogram 


FINISH = false 


Establish: X jax 5% mins V (no. of 
Ax intervals in range), L 
{order of polynomial approxi- 
mation for f(x)] 


Provide a new random value of x(t) each 
time program returns here; 
FINISH is made true at the end of the 
generation of values of x, = x(t) 


CALL PROBDENSITY(X, Ximax+ Xmin» Xt», £, START, FINISH) 


if L is too large, the matrix 
resulting when SMOOTH, in turn, 
calls SIMQ, will be near-singu- 
lar; SIMQ subroutine will so 
indicate 


return for new random 
value of x, 


CALL PROBDENSITY(x, Xmax» Xmin» Xt» 2, f, START, FINISH) 


data-smoothing subprogram; 
see Appendix 9A 


Print values of B 
list and/or plot f versus x 


CALL SMOOTH( 


FIGURE 9-5 
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mum expected values of x(t), Xmax aNd X,;,, are established, as is N, the 
number of increments Ax into which the range from Xi, tO Xmax is to be 
divided. These values should be selected so that the middle of each incre- 
ment Ax will be based on some reasonably round series of decimal values 
for the purpose of listing and plotting. 

Every time a new random x(t) is produced (called x, in the flow dia- 
grams), the subprogram PROBDENSITY is called. Finally, when all values 
of x(t) have been generated, FINISH is made true and the subprogram 
PROBDENSITY called for the last time. The result will then be values of 
the probability density f(k) versus the values x(k) corresponding to the 
middle of each Ax interval, with values for k from 1 to N. 

The probability-density subroutine itself is shown in Figure 9-6. The 
first time it is called, when START is true, the counters for COUNT (the 
number of values of x(t) furnished) and for f(k) are set to zero. Although 
J (k) eventually will be the probability density at each value of x(k), it will 
initially be simply a count of the number of times that x(f) falls within the 
kth interval. At the start of the use of the subprogram, the values of x(k) 
are also established. START is then made false so that these computations 
will not be repeated unnecessarily. 

During the first and each subsequent call on this program, until 
FINISH is made true, COUNT is advanced one and location k of the Ax 
interval in which x(t) falls is established; the count f(k) for this interval 
is then advanced by one. At the end of this part of the operation, f will 
constitute a record of the number of times x(t) has fallen within that Ax 
Tange. 

When FINISH is true and the subprogram PROBDENSITY is called 
for the last time, the number of times x(r) has fallen within a given range, 
the present f(k), is divided by COUNT#Ax [number of Ax intervals multi- 
plied by the total number of x(t) values]. The result now becomes the new 
J(k) and corresponds to the probability density as defined by relation (9-1) 
with, however, Ax remaining finite (although preferably as small as storage 
limitations will permit) rather than truly approaching zero. 

If the probability density f(x) of the signal involved, x(r), were truly 
a smooth function of x (as it very well might be) and if an infinite number 
of values of x(t) could have been furnished, it would be expected that the 
relationship between f and x, while discrete, would nevertheless be smooth. 
However, because the number COUNT of values furnished must be reason- 
able, although preferably as large as is practical, the actual relationship 
obtained will probably be quite irregular when observed from interval to 
interval. It might be difficult under these circumstances to determine the true 
functional nature of f; For this reason a smoothing operation is usually 
desirable. It should be realized, however, that such an operation never adds 
but rather always detracts from the statistical accuracy of the results; the 
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SUBROUTINE PROBDENSITY (Xx, Xmax+ Xmins Xt, 0, f, START, FINISH) 


do for all Ax 
intervals 


start of count of times 
x, falls within each 
interval 


center of each 
interval 


x(k) = Ax* (k — 0.5) + Xnin 


to avoid re- 
peated division 


START = false 


truncated value of 
| k = trunc((1/Ax)*(x, — Xin) + 1 | & to locate interval 
in which x, falls 


yes 


Sk) +1 
COUNT = COUNT + | 


advance count for 
this interval 


RETURN 


FIGURE 9-6 
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conversion factor 
to change f(k) to 
probability density 


CONV = (1/Ax) / COUNT 


DOk=1toN 


S(k) now probability 
density 


S(k) = f(k) *CONV 


RETURN 


FIGURE 9-6 (cont'd) 


only justification for its use is the fact that it does permit a more understand- 
able description of f(x). 

In the particular type of program shown for example here, the smooth- 
ing operation approximates f(x) as a polynomial in x having L terms (i.e., 
of order L — 1), Note that L was also established at the start of the main 
program. The method of least-mean-squares fit is employed. If computer 
roundoff errors and the limitations imposed on floating-point ranges were 
not a problem, L preferably should be as large as possible (but less than N). 
Actually, if L is made too large, a near-singular matrix results when an 
attempt is made to find the polynomial’s coefficients. For this reason L is 
practically never made greater than 6, the best value depending on the degree 
of irregularity of f(x). 

Hence, after the last call of the subprogram PROBDENSITY has been 
made, a smoothing operation is performed by calling another subprogram, 
called SMOOTH, which is designed for this general purpose. As the algorithms 
for this latter subprogram are only incidental to the subject matter here, 
they will be discussed in Appendix 9A. 

Subroutine SMOOTH involves a common logical argument, called 
SINGULAR. If the matrix involved is near-singular, this will be set to true 
and, as Figure 9-5 shows, a printout explaining this difficulty is obtained 
instead of the results desired. The usual cure is to make L smaller. 

If the above difficulty is not encountered, an array B of dimension 
L is obtained after the subprogram SMOOTH has been called. This array will 
represent the coefficients of the approximating polynomial, which is of the 
form 


f(x) = BO) + BQ)x + +++ + B(L)x*"! 
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Sometimes the interest is in the values of these polynomial coefficients; at 
other times it will be in providing either a listing and/or plot of f(x) versus 
x as based on these coefficients. What the main program does at this final 
stage, therefore, depends upon the application involved. 

There will be times when a finite probability exists of x(t) having a 
specific value x; f(x) will then contain an impulse at this value of x. This 
has been discussed in the preceding section. The nature of the problem will 
indicate when this is expected to be the case [e.g., when x(t) has been subjected 
to hard limiting]. Under such circumstances, the value of the probability 
density computed for this value of x should be omitted from the smoothing 
operation. 


9-6 Describing the Time Variation of the Random 
Variable—Power-Spectral Density 


The probability density or distribution discussed above describes only the 
amplitude characteristics of the random time function. For faithful simula- 
tion in a dynamic problem, the manner by which the variable varies with 
time must also be represented. This manner of variation can be described 
conveniently (but not completely for all purposes) by the power-spectral 
density, ®,,(@). This concept is described in many textbooks dealing with 
random variables and only certain basic features of the power-spectral 
density will be reiterated here. 

®,,(@), the power-spectral density of the random variable x(t), des- 
cribes the frequency content of [x(t)}’. The word power appears in the 
description because the square of many physical variables does happen to 
be indicative of power. Its significance may be explained by a hypothetical 
experiment. 

Suppose that the random time variable x(t) was applied to a band-pass 
filter that has a pass range from the frequency @ to w + Aq. Within this 
pass range the transmission is assumed to be unity; outside of it, zero, (The 
fact that such an ideal filter cannot be built because of certain basic limita- 
tions of network theory is the reason why this experiment is described as 
hypothetical.) 

The output of this filter, described as x,, would contain only the fre- 
quency components of the random variable that lie within this frequency 
range. This output is then squared and the average value of this result is 
determined, the averaging being conducted over a sufficiently long time 
period. What will be obtained will be represented here as (pis the bar over 
the symbol indicating the process of time averaging. Figure 9-7 illustrates 
this experimental procedure. The time constant of the averaging filter must 
be such that wt >> 1, where @ is the lower band limit of the filter. 
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The quantity obtained when (x,)? is divided by the filter bandwidth, 
Aq, is an approximate indication of ®,,(@) for the value of @ employed 
in the filter. As Aw is made progressively smaller, this ratio approaches 
a constant value and, in the limit, as Aw — 0, it becomes exactly ®,,(@). 
That is, 


Bp (CRE y 
0. i e 


The above process may then be completed over the significant range of o 
to obtain the complete spectrum. 
Power-spectral densities of typical random variables may take on a 
number of forms. One common one is 
— 2070 9- 
®..(0) = oe 
Such a spectrum would appear when plotted as in Figure 9-8, In relation 


,..(w) 


FIGURE 9-8 


(9-8), @, is called the half-power frequency for reasons obvious from the 
plot. o, is the mean deviation of the random signal x(t), generally defined 
for all random functions by 


o% = E[x*] — [E(x)? (9-9) 
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where E[x?] is the expected value of x? (i.e., the mean-square value). E(x) 
is the expected value of x itself (i.e., its average). In the example represented 
by relation (9-8), the average value of x(t) must be zero (for reasons to be 
discussed below); hence, for this case, o2 = E[x?]. 

One property of any spectral density function is that the area under 
it, when plotted versus x, is an indication of the mean-square value of the 
function (i.e., E[x?]). Specifically, 


El] = + [°®,.@) do (9-10) 


Substitution of relation (9-8) in (9-10) would indicate, after performing the 
integration operation, that for this particular example the expected result 
would be obtained that E[x?] = 03. 

Another form of power-spectral density discussed frequently is white 
noise, where 


®, .(@) = n = constant for all w’s (9-11) 


The power spectrum for white noise appears as in Figure 9-9. Substitution 


®,,(w) 


FIGURE 9-9 


of relation (9-11) in (9-10) will show that E[x?] becomes infinite, indicating 
a random disturbance of infinite intensity. Hence ideal white noise is a strictly 
theoretical concept. What usually is meant by white noise, as in commercially 
available white-noise generators, is that the power-density spectrum remains 
essentially constant within the frequency range of interest; of course, it 
must approach zero as @ approaches +00, (It should be noted that although 
it is a mathematical convenience to consider @ as possessing both positive 
and negative values, as is done when employing the Fourier transform of 
deterministic functions, the power-spectral density of real random variables 
will always be an even function of @.) 

Another typical form of power-spectral density might appear as in 
Figure 9-10. A random function described by such a spectral density would 
have most of its frequency components in the vicinity of @,, and would possess 
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what at first appeared to be a periodic component; however, further inspec- 
tion would, show that this apparently periodic portion also was random in 
both phase and frequency. A power-spectral density of the type shown 
could result from the amplitude modulation of a carrier signal, at frequency 
@,, by a random modulating signal. As another example, sea waves sometimes 
exhibit almost sinusoidal swells in the vicinity of some particular frequency. 

A limiting case of the example shown in Figure 9-10 exists when a 
truly sinusoidal signal of one specific frequency exists mixed with the re- 
mainder of the random signal. In this case an impulse function of w appears 
in the spectrum at +@,. This is shown in Figure 9-11. The existance of an 
average value, E(x), or the d.c. component, corresponds to the above instance 
where q@, is zero. The impulse would then appear at a = 0. 


, .(w) 


—w, Wy 


FIGURE 9-11 


The discussion of the significance of the power-spectral density has 
been presented because, in simulation problems, it is always important that 
the spectral density of the simulated disturbance match that of the distur- 
bance being simulated. This is a necessary condition for faithful simulation. 
As a matter of fact, when the performance of /inear systems is being investi- 
gated, it also is a sufficient condition. For this reason the ability to evaluate 
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the power-spectral density of random signals produced by experimental 
observations or by other simulations is discussed next. 


9-7 Evaluation of the Power-Spectral Density 


It is not feasible to evaluate the power-spectral density of random signals 
by analog methods alone. Until a few years ago evaluation by digital means 
was a tedious process, involving first the evaluation of the inverse transform 
of the power-spectral density (i.e., the autocorrelation function), However, 
new direct and efficient algorithms have been developed based on a general 
technique known as the fast Fourier transform (FFT). The paper by E. O. 
Brigham and R. E. Morrow [2] provides a good general survey of these 
methods. 

Because the algorithms used for this purpose are still in such a rapid 
stage of development, nothing could be said about them in any book that 
would not be very out of date by the time of publication. Use of the most 
efficient algorithm is important because evaluation of the spectral density 
of a random signal will, in any event, consume excessive expensive execution 
time; hence these newer algorithms have been concentrating primarily on 
ways of reducing execution time. Quite possibly the most efficient and 
economical methods will involve the use of hybrid analog—digital computers. 
In any event, anyone interested in employing the FFT should examine the 
current literature to find the most efficient technique applicable to his needs. 
No attempts will be made to describe the method here. Hopefully, the latest 
FFT programs will become standard parts of digital-computer libraries 
devoted to scientific applications. 


9-8 General Consideration in the Simulation 
of Random Disturbances 


There are a number of different approaches to the problem of supplying 
random disturbances for simulation purposes. 


1. The disturbance to be simulated itself, if available and occurring 
concurrently, may be applied to the simulation model, usually in 
the form of an equivalent electrical voltage or equivalent digital 
indication. This implies real-time simulation. 

2. A recording of the actual disturbance may be used, as in the form 
of an analog or digital recording on magnetic tape. As the play- 
back rate of such a record need not necessarily be the same as the 
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recording rate, real-time simulation is not necessarily required with 
this method. 

3. An equivalent random disturbance may be generated in analog 
form by one of the means to be discussed in the section to follow. 

4. The distubance may be derived from a series of random numbers 
generated in digital from, either from a random-number library 
program or from special program devised (fo) this purpose. 

5. A pseudorandom signal designed to match the power-spectral 
density and probability density in an at least approximate sense 
might be created to match the actual disturbance. One way of 
accomplishing this is by adding the outputs of a series of indepen- 
dently generated sinusoidal signals having frequencies that bear 
no integer relationship with each other. This method will also be 
described in more detail. 


An important distinction must be made between repeatable and non- 
repeatable random disturbances. Usually the purpose of simulating systems 
subject to random disturbances is for the comparison of different system-design 
techniques, such as specific mechanical design features or parameter adjust- 
ments in control systems. If the various techniques to be investigated are com- 
pared by sequential test, it is important that they be subjected to random 
disturbances of the same degree of severity. Even though the same random 
disturbance is applied (in the sense that it has the same amplitude probability 
density and the same power-spectral density), and even though this disturbance 
is truly stationary, a series of such tests, each of limited duration, may result 
of some of the models being tested being subjected to more severe phases 
of the disturbances than others. This disadvantage, which can affect the 
validity of comparison, can be overcome only by 


1. individual test runs, each of an unusually long duration (with 
obvious disadvantages, including expense of testing), or 
2. applying the same disturbance in turn to each model. 


Recourse 2 is generally the most practical but places restrictions on 
the choice of methods, as listed from 1 to 5 above, that might be employed. 
A repeatable source of random disturbance is required. Method 1, involving 
the actual disturbance itself or its electrical indication, will not suffice for 
obvious reasons. This very fact is what often makes computer simulation of 
systems desirable for comparison purposes, even when direct tests on the 
equipment being simulated are a practical possibility. For example, when 
comparing the effectiveness of different aircraft-autopilot designs by means 
of actual flight tests, the apparent superiority of one design over another 
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might simply be due to the more favorable air-turbulence conditions at the 
time the better system was tested. 

Method 2 obviously fulfills the repeatability requirement when such 
a requirement is applicable. Method 3, involving analog generation of ran- 
dom disturbances, does not. Method 4, involving digital generation of 
random disturbances, may or may not fulfill the repeatability requirement, 
depending on the technique of random-number generation used. Method 5, 
in theory, will fulfill this repeatability requirement and will do so in fact 
when implemented by digital methods. When analog methods are used, 
however, slight drifting in the frequencies of the sinusoidal signal generators 
from one run to another may result in imperfect repeatability unless the 
durations of the runs are fairly short. 

Methods | and 2 as techniques for supplying random disturbances to 
a simulation program are self-explanatory and will not be discussed further 
here. Methods 3, 4, and 5 have in common the fact that the disturbance is 
created as part of the computer simulation process. These methods will 
require further explanation, to be given in the sections that follow. 


9-9 Generation of Random Signals in Analog Form 


This relates to method 3 of Section 9-8. A number of experimental tech- 
niques have been proposed and tried, but the two employed most frequently 
are 


1. The use of gas-tube noise generators. 
2. The use of pulses generated by a Geiger—Miiller counter exposed 
to a radioactive source. 


Method 1 is used frequently in commercially made noise generators. 
The random fluctuations in ion density about the cathode of a gas tube 
(e.g., thyratron) result in noise signals being created that have a normal 
probability density and a power-density spectrum ranging from about 30 Hz 
to about 2 kHz. These signals are modified by a variety of electronic means, 
including means for introducing a frequency shift, so that the output spec- 
trum will be essentially flat (i.e., white) from zero to anywhere from 50 to 
200 Hz, depending on the design of the equipment. The actual electronic 
circuitry necessary to produce a good source of Gaussian white noise is 
fairly complicated; this is generally the concern of the equipment manufac- 
turer, not of the persons preparing the simulation program. 

Method 2 is illustrated in Figure 9-12. The radiactive source emits 
particles that actuate the Geiger-Miiller (G—M) tube and result in a train 
of pulses, e,(t). The arrival time of each pulse is independent of that of any 
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other pulse and can be described statistically by the Poisson probability 
distribution. This means simply that the probability of n pulses arriving during 
a specified time interval ¢, will be 


Pn, t, = Uy exp (— Mt.) (9-12) 


where A will be the mean frequency of pulse arrival, a function of the inten- 
sity of the radioactive source and of its proximity to the Geiger—Miiller tube. 
For example, the probability of no pulses arriving in a time interval ¢, is 
P{0, t,} = exp (—At,). 

For some simulation applications the output of the Geiger—Miiller 
tube shown in Figure 9-12 may be directly representative of the type of ran- 
dom signal desired, but for most purposes this signal must be shaped to 
another form. This is done most readily if the output of the Geiger—Miiller 
tube, e,(¢), is first used to trigger a multivibrator that has an output switch- 
ing alternately between +E and —E V. (Such a circuit is easily constructed 
from analog-computer elements; see Chapter 6.) The output of such a mul- 
tivibrator circuit, e,(t), will now be described by an amplitude probability 
density expressed as 

P{e,} = 0.5[5(e, — E) + d(e, + E)) (9-13) 
and appears, when plotted, as in Figure 9-13. The power density spectrum 
of such a signal can be shown to be expressed as 

2E72 
®.,..(@) = ota (9-14) 
The plot of this power-spectral density function will appear as in Figure 
9-8, with the half-power frequency appearing as the mean frequency of pulse 
arrival A, 

Again, although it is possible that the random-signal output of the 
multivibrator may be directly suitable for some simulation applications, in 
most cases a different form of amplitude probability and/or power-spectral 
density will be required. This will be accomplished by applying the output 


424 Simulation of Random Disturbances and Their Effects Chap. 9 


P{e,} 


0.58(e) + E) 0.56(e, — E) 


FIGURE 9-13 


of the multivibrator, e,(t), to the low-pass filter shown in Figure 9-12, obtain- 
ing the actual random signal desired for simulation purposes, e,(t). The 
design of this filter depends. upon the power spectral density ©,,,,(@) that 
is desired and is based upon the considerations discussed in the next section. 

In most applications it will be desired that the amplitude probability 
density of e,(t) be of the normal or Gaussian type. Although a rigorous proof 
is tedious, it can be shown that a normal form of amplitude probability density 
will be approached as the amplitude response of the shaping filter approaches 
zero for frequencies of a magnitude equal to or greater than the mean frequency 
of pulse arrival 2. In practice this means that the transmission of the filter 
should be negligible in this frequency range, or, conversely, that 4 should 
be chosen to be significantly greater than the bandwidth of the filter. If this 
is done, the output e,(t) will be of essentially Gaussian form, subject, how- 
ever, to the inevitable limitations on the amplitude range of the electronic 
equipment (since a truly Gaussian or normal density implies some exceedingly 
small but finite probability of signals beyond the normal signal-handling 
range). This necessary relationship between filter bandwidth and the fre- 
quency A is why the shaping filter shown in Figure 9-12 is described as low 
pass. 

There are a number of other methods of analog generation of random 
signals that have also been employed. More detailed treatment of these, 
as well as the two techniques that have just been described, are discussed 
in the literature [3]. 


9-10 Analog Techniques for Shaping 
Power-Spectral Densities 


The relationship upon which the design of the shaping filter is based is 
quite simple. If, with reference to Figure 9-12, e,(t) is the random input to 
the filter and e,(f) is the random output, and if the transfer function relating 
them is designated as G,,(s); i.e., if 


E,(s) = G,,(s)E,(s) (9-15) 


Sec. 9-10 Analog Techniques for Shaping Power-Spectral Densities 425 


then it will be true that 

®,,.,(@) = G32( j@)G;2(—J@)®,,..(@) (9-16) 
or 

®,,..(@) = |G52(jo)?®,,..(@) (9-17) 
This is one of the basic relations of random-signal theory and its proof will 
not be repeated here. 

Suppose, for example, that a power-density spectrum of the form of 

relation (9-8), shown plotted in Figure 9-8, was desired for e,(t); i.e., 


®,,,(0) = 32a, (9-18) 


when, as given in relation (9-14), 


2 

®,,.(c0) = 224, (9-19) 

{In relation (9-18), o, is the mean deviation desired of the signal e,(t).] 
Practically by inspection it can be established that the necessary filter 


will be of the form 
G3,(s) = Seal (sth S 2) 


eae ES (i8 re) Seid 


Such a transfer function is simply represented by basic linear analog-com- 
puter elements. For @, < A the filter would have the amplitude character- 
istic shown plotted in Figure 9-14. If A >> @,, the effect of this low-pass 
filtering would practically result in the amplitude probability density of 
e,(t) being Gaussian, as discussed in the preceding section. However, also 
as mentioned previously, the amplitude probability density of the simulated 
disturbance is usually important only when nonlinear systems are being 
evaluated. 

Relation (9-20) was obtained by inspection. Actually, a simple mathe- 


G33(jw) 
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FIGURE 9-14 
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matical procedure may be employed for determining G,,(s) in a more formal 
manner that does not depend on intuition. Both of the power-spectral den- 
sities can be expressed as the product of two conjugate functions of (ja). 
For example, 


®,,..(@) = F.,(Jo)F.,(—@) (9-21) 


F..(j@) = GE Eark (9-22) 


(In general, the above result may be obtained by factoring the denominator, 
expressing the power-density function as partial fractions, and using the 
method of undetermined coefficients to find the numerator terms.) 

Also, 1 


where 


# (0 )FJo)Fa(-I0) (9-23) 
where 
F.(jo) = 2 Fe0/o 9-24 
OO) ai (9-24) 
The correct G,,(j@) function then is 
io) — Fe(J@) 
G,,(jo) = F(a) (9-25) 
where, for this specific example, 
G,,(j@) = 4 9(2+2) (9-26) 


If in the above (jw) becomes s, relation (9-20) is obtained. 

This method for finding the proper transfer function of the shaping 
filter may be used whenever the power-spectral densities involved are of a 
form that can be expressed as the ratio of polynomials in @?. When this is 
not the case, more ingenious techniques beyond the scope of this chapter 
are required. When one of the power-spectral density functions is empirical, 
it first is necessary to employ curve-fitting techniques in order to express it 
in the above-described polynomial form. 


9-11 Analog Techniques for Shaping Amplitude 
Probability Densities 


As stated previously, when the effect of random disturbances on nonlinear 
systems is to be simulated, it is important that the amplitude probability 
density of the simulated disturbance match that of the actual disturbance 
being simulated. Therefore, after the desired power-spectral density has 
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been obtained by a shaping filter, as described in the preceding section, a 
second amplitude-shaping filter should be used to assure that the probability 
density is of the desired form as well. It is important that this amplitude- 
shaping filter follow the operation of the spectrum shaping filter because the 
former would modify the probability density. 

The problem becomes that of the situation pictured in Figure 9-15. 
A random signal x(t) of known (or determinable) probability density f,(x) 
is to be applied to a zero-memory filter (having no dynamics) that establishes 
the functional relationship y = g(x). The output of this filter, y(t), should 
have some specified probability density f(y). The problem specifically is 
that of finding the necessary function g(x). 


x(t) yo) 
FIGURE 9-15 


There is no unique answer to the problem of determining g(x); an 
infinite number of suitable functions exist. However, if it is specified that 
g(x) must be a single-valued function of x (i.e., a true function) of a slope 
that is never negative, then a unique solution does exist for this condition. 
The solution, will, in fact, result in a simpler shaping filter than with any of 
the other solutions. 

The relation between the probability densities f,(x) and f,(y) and the 
function g(x) is more easily handled in terms of the probability distributions 
F,(x) and F,(y), instead. The probability distribution F(x) is related to a 
corresponding probability density f,(x) as follows: 


FQ) = f° £.G) ax (9-21) 
Hence, of course, 
£2) = 4) (9-28) 
and it is easily shown that 
F(x) = P{x(t) < x} (9-29) 


As x approaches infinity, F,(x) must, of course, approach unity. 
With the restriction on g(x) stated above it can be shown that 
F(x) = Flg@)] (9-30) 
Figure 9-16 illustrates the graphical (nomographical) procedure that 
might be employed to determine g(x), given f,(x) and f,(y). The relation- 
ships for f,(x) and f,(y) are integrated to obtain F,(x) and F,(y). Then, in 
step (1), a given value of x is selected. Projecting upward to (2), the corre- 
sponding F,(x) is found. Projecting horizontally, in accordance with relation 
(9-30), the corresponding y is found at (3). This is projected onto the g(x) 
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FIGURE 9-16 


plot by first projecting downward to (4), and then horizontally to point 
(5), aligned vertically with the initial starting point (1). By repeating this 
procedure for a number of values of x, a curve of y versus x [i.e., the g(x) 
relationship] may be drawn. 

In some instances an analytic expression for x is possible. For example, 
if the available random signal x(t) is Gaussian with zero mean value, and 
[from relation (9-6)] is described by a probability density 


ayeal Licey 
LQ) = / 200, exp [-3(2) i 
and if the desired signal y(t) is to have a uniform probability density between 
y = —aand y = 5, then 


Agha 
LY) = a5 
= 0 fory< —aory>b 


for—a<y<b 


This is essentially the situation pictured in Figure 9-16. 

In this example the required shaping function g(x) can be determined 
directly. This is done by first expressing the corresponding probability 
distributions: 


F(x) = > + erf (+) 
0 for y< —a 
F{y)'= — for —a<y<b 


1 for y>b 
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Relation (9-30) may then be applied directly: 


x + ert (=) Fy) pe for—a<y<b 


where y in the above is the required function, g(x). Solving for y in the 
range where f(y) is nonzero yields 


y=-—a+(at+ i> + ert(*)| 


=°54 + @+ Het(*) 


F(x) 


or 


ax) = 254+ @+ by erf (2) 


x 


The general shape of this function is shown in Figure 9-17. 


y= g(x) 


FIGURE 9-17 


With other probability densities it may not be possible to obtain a 
direct algebraic expression for g(x), but it may be possible to obtain one 
for the inverse function, g~!(y) = x. In some cases, however, no algebraic 
expression is obtainable and it is necessary to resort to the graphical opera- 
tions shown in Figure 9-16, or their equivalent. 

It might be noted that to be “shapable” to other probability density 
forms, the input signal x(t) should not consist of only discrete values [i.e., 
F(x) should not contain on/y impulses]. For this reason the output of the 
multivibrator in Figure 9-12 would not be directly adaptable to: probability- 
density shaping. However, if (as has been recommended above) the spectral- 
density-shaping filter was used first, its output would no longer contain discrete 
values and could be shaped to other probability-density forms. 

The operations indicated in Figure 9-16 are accomplished most easily 
by digital-computer means (unless a simple algebraic solution is obtainable 
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as in the example just given). For purposes of analog simulation, this could 
be used as the basis of setting up a diode function generator that performed 
that shaping-filter function. 


9-12 Digital Methods for Generating Random 
Disturbances 


The subject of producing random variables by digital-computer means is 
one that has received wide attention and study [4]. The need for such methods 
arose originally not in connection with simulation, but rather in connection 
with the Monte Carlo method of problem solution. 

A number of techniques have been proposed. Most but not all are 
repeatable, and therefore meet that usual requirement discussed in Section 
9-8. Only such repeatable techniques will be discussed here. It may be argued 
that such repeatable random variables are, in the true statistical sense, deter- 
ministic, and not random at all. This is true, but it constitutes no impediment 
to their use in simulation problems. All such methods have a period at which 
their pattern will repeat. This also is no disadvantage, provided that the 
period is sufficiently long. Four criteria usually are employed to evaluate 
the suitability of random-variable generation techniques: 


1. Length of the period. 

2. Uniformity of the amplitude-density spectrum. 
3. Small degree of autocorrelation. 

4. Speed of computer execution. 


The first criterion simply means that the period should be larger than 
the intended test duration. The second implies that a uniform probability 
density (Figure 9-3) is to be obtained and that the degree of true uniformity 
is to be a measure of quality. Of course, digital-computer programs cannot 
produce variables having other than a possibly large, but nevertheless finite, 
number of discrete values and the probability-density curve would consist 
only of impulses. The probability distribution would be a staircase type of 
function, as pictured in Figure 9-18. If this staircase function follows suffi- 
ciently closely a straight line of slope equal to 1/x,,,;, it is then an adequate 
approximation for the probability distribution of a random variable with 
a truly uniform density. It should be noted that in Figure 9-18 only positive 
values of the random variable are produced. This is the case for purposes of 
computational convenience; obviously the range can be shifted to negative 
values, just as the scale can easily be modified. 

The third criterion, if met perfectly, would mean that zero correlation 
would result, corresponding to true white noise. This will not be the case with 
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any of the methods that have been proposed, but only a reasonably small 
amount of autocorrelation (and consequent deviation of the power-spectral 
density from a white-noise form) should be considered allowable. The signifi- 
cance of the fourth criterion is obvious from the standpoint of economy of 
time and expense. 

The only true criterion of merit is the applicability of the method used 
to the problem at hand. From this viewpoint it will be found that methods 
that are very satisfactory for some applications will show marked defects 
when applied to others. The person concerned with preparing the simulation 
program will consider random-variable generation to be a tool, not an end 
in itself. Hence, he ordinarily will care to devote little time to research on 
what is the best method for his purposes. A method that is adequate and does 
not present unexpected pitfalls will generally be all that he asks for. Fancier 
and faster methods may exist, but one apparent characteristic of such 
methods is their tendency to get into trouble when various situations arise, 
such as looping (i.e., suddenly encountering a repetitive pattern of very 
short period). 

With these considerations in mind, the method to be suggested here 
for general simulation purposes is the one imposingly described as the multi- 
plicative congruent method.” The operation is described mathematically as 
follows: 


X;4; = ax,(mod m) (9-31) 
This terminology, used in number theory, means simply that the last value 
of the variable, or x,, is multiplied by a constant a and then divided, in the 
integer sense, by m; the next value of the variable, or x,,,, is the remainder. 
For example, if a = 8, m = 64, x, = 11, then x,,, would be the remainder 
resulting when ax,, or 88, is divided by 64, or x,,, = 24. 
In practice, it is recommended for binary machines [5] that 


1. The starting value, x,, be some odd number less than m. 
2. m = 2', where i is some integer, naturally selected within the range 
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of the computer and in consideration of the fact that the period 
will be m/4. This period should be substantially larger than the 
expected duration of the run, 

3. a should be of the order m (i.e., approximately 2'/*). It should 
also meet the criterion that a = 8k + 3, where k is any integer. 


As an example, if it is expected that a series of 10,000 random numbers will 
be required, a reasonable value of m should be greater than 40,000, or, say, 
m = 2!5 = 32,768. a should be in the vicinity of 275 or 181. The closest 
value to this that satisfied the form 8k + 3 is the integer 179; hence a is so 
selected. The random pattern developed will depend upon the starter Ros 
Say x, = 11. Then 


xX, = 179-11(mod 32768) = 1969 
xX, = 179-1969(mod 32768) = 24,771 
ete, 


The range of x, will be between zero and m (i.e., 0 to 32,768) but with it 
being noted that all the random numbers produced will be odd integers, 
The result can be translated and scaled to any range desired. 

To obtain the fastest machine speed, the instructions for such a pro- 
gram should be given in binary-integer form, preferably in machine language.? 
Various techniques can be used to obtain a rapid execution, such as by 
utilizing register overflow to obtain the necessary remainder. The method 
best employed will depend upon the computer being used, and instructions 
are often furnished by the computer manufacturer for the most efficient 
utilization of this standard type of program. 

When employing decimal-type machines, the rules for most efficient 
utilization of this method vary somewhat. Then: 


1, The starting value x, again must be some odd number less than m. 

2, m= 10', where again i is an integer, now selected on the basis of 
the period being m/20. 

3. a should again be of the order of ./m. It now should meet the 
requirement that a = 200k +r, where k may be any positive 
integer and r is 3, 11, 13, 19, 21, 27, 29, 37, 53, 59, 61, 67, 69, 77, 83, 
or 91, 


Let the same situation be considered as before where a series of 10,000 
random numbers is required. Since the period is m/20, m should be greater 


2With user-oriented languages such as Fortran or Algol, the number of significant 
digits handled is usually inadequate unless special forms of operation, such as double preci- 
sion, are employed or unless the mod function is available in the program library. 
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than 200,000. Hence m = 10° is chosen. a should be of the order of ./m, 
or 1000. To meet the recommended form a = 200k +r, let k =5 and 
r= 3; then a= 5-200 + 3= 1003. Then, with m= 10° and a = 1003, 
let the first two steps be considered with x, = 11: 
= 10003-11(mod 10°) = 11,033 
xX, = 1003-11033(mod 10°) = 66,099 

etc. 


x 


The range of x, will now be between zero and mi (i.e., between 0 and 
1,000,000). Again, only odd interger values of x will result. 

Again, the most effective programming of such a decimal digital opera- 
tion is often furnished by the computer manufacturer. This has been studied 
by many, and there are published reports describing the most effective tech- 
niques for executing such a program [6]. 

Often the computer being used will contain one or more programs for 
random-number generation in its library, and use of one of these will relieve 
the person preparing the simulation program from the necessity of preparing 
the random-number generation program as well. However, many of these 
library programs were designed with Monte Carlo methods in mind, where 
the white-noise requirement generally is not as important as it is in simulation 
studies. For this reason, before employing such a program, it may be well 
to examine both the probability density and spectral density by the general 
approach discussed in Section 9-7. 


9-13 Autocorrelation Function 


To analyze the statistical nature of random-number sequences, it is most 
convenient to consider the inverse transform of the spectral density (i.e., 
the autocorrelation function), This probably will be well known to many 
readers in far greater detail than the brief description that follows here. 

As mentioned, the autocorrelation function y,,(t) is the inverse 
Fourier transform of ®,,(@); i.e., 


Wealt) = ef ®,,(o)el" dt (9-32) 
and, conversely, 
®,.(0) =f yaa(t)e* de (9-33) 


If we are willing to assume that the signal being dealt with is stationary, 
then the autocorrelation function may be determined from the relation 


Wax(T) = E[x(t)x(t + 7)] = x(2)x(t + 1) (9-34) 
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where E represents the expected value (i.e., the average value of the product 
as averaged over a statistically sufficiently long averaging time). 

For theoretical analysis purposes, it is frequently simpler to employ 
relation (9-34) first, and then to obtain the power-spectral density by means 
of relation (9-33). (Prior to the development of the FFT algorithms, this 
procedure was also that used for the analysis of empirical data.) 


9-14 Statistical Nature of Random-Number 
Generator Outputs 


Before considering means by which the outputs of digital random-number 
generators may be shaped to represent the disturbance being simulated, the 
statistical nature of the random signals produced by these generation pro- 
cedures should be understood. All the procedures mentioned produce what 
is, at least approximately, a uniform probability density of integers ranging 
from x = 1 to x =™m. That is,? 


as for0<x<m 


f= ym" 
0 forx<Oorx>m (9-35) 
The mean value of any random variable may be computed from its probabil- 
ity density as follows: 


E(x) =f" xf(x) dx (9-36) 
Applying this relation to (9-35) yields the obvious result 
—. foal mn . 
E(x) = f x dx =F (9-37) 


The mean-squared value of any random signal may be determined by the 
relation 


E(x) = ["_ x*f(x)dx (9-38) 
Applying this to relation (9-35) yields the result 
en gee peers . 
E(x?) = i dx => (9-39) 


The mean deviation is defined as the mean-square value after the mean value 
has been removed, or is 


o3 = fale — EQ)PS() dx (9-40) 
and can easily be shown to be 
o% = E(x?) — [EQ (9-41) 


3[t is assumed that the output of the random-number generator has been modified 
by an obvious algorithm to include even as well as odd integers from 1 to m. 
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Hence the random signal produced by the digital means described has a 
mean deviation of 
AY me m)\? — m* 
ee: oa 

Therefore, the first step to produce a purely random signal from the 
random sequence of numbers generated is to remove the d.c. (i.¢., subtract 
the mean value). The signal remaining after this is done will be designated 
as x(f). Its autocorrelation function and corresponding power-spectral den- 
sity are now to be determined. 

Since whatever signal is produced by the digital signal generator at 
the beginning of an iteration interval At is assumed to apply throughout the 
interval, such a random signal is equivalent to a stepwise continuous signal 
as shown in Figure 9-19. 


x (0 


FIGURE 9-19 


If each number generated, x,, is statistically independent, then the 
autocorrelation function of the above signal can be determined by use of 
relation (9-34), which is of the form shown in Figure 9-20, Inevitable imper- 
fections in the white-noise properties of the random-number generation 
process will result in the presence of some amount of autocorrelation for 
values of |t| greater than At. 

By employing relation (9-33), the corresponding power-spectral density 
of the random signal x,(t) may be established as 


®,,,,(0) = 0 Ar = Pos AD 


F@ Ary 
__ m* Atl 1 — cos (@ At) 
al [ T(@ Ary? ] ag 


When plotted, this spectral density will appear as in Figure 9-21, 
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If the iteration interval is sufficiently small (i.c., @ At << 1), relation 
(9-43) becomes approximately 


®,,,,(@) = m mei (@ cs (9-44) 


and if @ At is small enough, for the range of ae @ involved in the 
simulation problem, it may be considered that operation takes place on the 
flat part of the spectrum curve near @ = 0; i.e., it may be considered that 
the signal is white noise with a constant spectrum of 


®,,,0) = = (9-45) 
It is on this basis that shaping filters will be designed to determine the actual 


power-spectral density desired to represent the disturbance. 


9-15 Shaping the Spectral Density of Random 
Disturbances in Digital Form 


The same general principles are employed for the purpose of shaping the 
spectral density of random disturbances when they appear in digital form 
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as are used for those appearing in analog form. These principles have been 
discussed in Section 9-10. The necessary modifying-filter transfer function, 
G,,.(s), is determined. From this the digital counterpart is established most 
easily by means of z-transform theory, as discussed in Chapter 3. 

Suppose, for example, that the power-spectral density of the actual 
disturbance to be simulated, y(t), is to be of the form illustrated in Figure 
9-8 and as described mathematically in relation (9-8). The shaped random- 
output signal then has a spectral density 

2, 
®,(@) = eo, (9-46) 

where g, is the mean deviation desired of the random signal and @, is the 
desired half-power frequency. The input signal to the filter is x,(¢), whose 
spectral density has been described in relation (9-45). 

Factoring ®,,,,(@) and ®,,(@) into a product of conjugate functions 
of ja, as discussed in Section 9-10, leads to 


®,,.,(@) = E,,(jo)F,,(—jo) 
®,,(@) = F,(jo)F,(—jo) 


where 
F,,(jo) = m,/At (9-47) 
T2 
and 
io) = 2x20 9-48 
F,(jo) a sar (9-48) 
Then, from relation (9-25), the necessary shaping-filter transfer function is 
240, i 
CSO) = Fal a (Tews) es) 
or, in operational form, 
2405 1 
CMO Freee (9-50) 


The last expression is the transfer function desired. However, it is recalled 
that this shaping operation is to be carried out by digital means. One way 
of doing this is by drawing the block diagram representing this transfer func- 
tion and then, when integration is called for, using one of the methods of 
numerical integration discussed in Chapter 3. However, an easier method, 
which will produce more satisfactory results, is to determine the z transform 
of the transfer function [i.e., G,,(2)]. By employing the procedure of Appen- 


dix 3A, the time-domain version of me or g,,,(t), is first expressed as 


Bya(t) = Sa] Oe eee (9-51) 
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or in terms of the number of iteration intervals, n, 


Biya) = S4/ 98 cova (9-52) 
Then by employing tabulation (2) of Table 3A-1, 
a, [240 Zz ¥(z) u 
G62) = Fal a" (=e) = Ye (9-53) 


This can be expressed in operational (g) form as 
y(n) _ ay A Pa( & ) 
x(n) mV At \g— e™* 
20, [Sea ( 1 ) 
mV At \1 — e-™4tg™? 


Hn) = emey(n — 1) + 282, [Sa y(n) (9-54) 


or as 


The procedure for generating this disturbance is pictured in block-diagram 
form in Figure 9-22. 


Generation of uniformly 
distributed random num- 
bers from x = 1 to 
x=m=1 


FIGURE 9-22 


As a specific numerical example, let it be supposed that the numbers 
are being generated on a decimal machine where m has been selected as 10°. 
The time-iteration interval being used in the simulation process is, for 
example, At = 0.001 sec. A random disturbance y(t) is desired with a power- 
spectral density of the form expressed in relation (9-46) with ¢, = 100 and 
@, = 5sec™!. Relation (9-54) would then become 


y(n) = 0.995y(n — 1) + 0.03464x,(n) 
With this decimal-machine procedure, the period of random-number repeti- 
tion is m/20 or, for this example, 50,000 numbers, representing a problem 


time duration of 50,000 At = 50 sec. Since @, = 5, this duration corresponds 
to @ot = 250, probably an adequate statistical averaging time for many prob- 
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lems. However, if this problem-time duration should prove to be inadequate, 
it would be necessary to select a higher value of m. 


9-16 Shaping the Probability Density 
of Random Disturbances 


Exactly the same procedures apply for shaping the amplitude probability 
density of random disturbances when they are presented in digital form as 
have been discussed for those in analog form in Section 9-11. Again, such 
shaping, when necessary, should take place after the power-spectral density 
has been shaped. 

Although the output of the random-number generator is usually of 
the type with a uniform probability density (as it is with the specific methods 
described previously here), the effect of most spectral-shaping operations 
will be to modify this probability density to an essentially Gaussian form. 
This will be the case whenever the spectral-density-shaping feature has a 
low-pass effect, as it will in most applications, and as it certainly would for 
the specific example of the preceding section. Then if, for example, a uni- 
form probability density was desired, it would be necessary to employ the 
type of shaping function shown in Figure 9-17. When the shaping function 
cannot be expressed in an analytic form involving functions available as 
subroutines in the digital-computer library, it will be necessary to prepare 
an empirical look-up table, supplemented by suitable interpolation proce- 
dures. 


9-17 Generation of Pseudorandom Disturbances 
by Superposing Sinusoids 


One method, often very convenient, for simulating random disturbances 
is by means of superposed sinusoidal signals. This procedure has the advant- 
age of providing directly the spectral density desired and eliminating the 
need for a later shaping filter. It also produces what is essentially a Gaussian 
form of amplitude probability density. 

This sinusoidal method is based upon a discrete frequency sampling 
of the power-spectral density. As an example, let a spectral density as plotted 
in Figure 9-23 represent the spectrum desired. For both the positive and nega- 
tive ranges of w, the area under the curve is divided into m parts of equal 
area. This is shown in Figure 9-24 with m = 5; in practice a higher value 
of m would normally be employed. 

For each of the ranges of @ when so divided, this portion of the curve 
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is now replaced by an impulse function located at the frequency that divides 
each of these areas into two equal parts; this impulse replaces the portion 
of the spectrum whose area it bisects. The total area under the curve will be 
2no?; this area is divided into 2m portions (considering the negative as well 
as positive range of w). Hence the size of each impulse should be 2o}/m. 
This is shown in Figure 9-25. Every spectrum line so created, designated as 
being at the frequency @,, is matched by a corresponding spectrum line at 
the frequency —q@,. The pair of positive and negative spectra for each value 
of k comprises a steady-state sinusoidal component of frequency @, of a 
fixed but randomly selected phase angle and with a mean deviation (i.e., 
rms value) equal to o2/,/m. That is, the approximation of the random dis- 
turbance with a spectral density as pictured in Figure 9-23 consists of the 
sum of such sinusoids, or 


y(t) = V7e: § sin (o,t + ,) (9-55) 


¢, is any randomly selected phase angle, different for each of the m sinu- 
soidal components, 

If m could be increased without limit while the above procedure was 
followed, a truly random signal having exactly the desired spectral density 
of Figure 9-23 could be generated in this fashion. Actually, a relatively small 
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value of m (e.g., m = 10) will result in approximations that are adequate 
for many simulation purposes. The actual signal produced is, of course, 
deterministic (just as it was when random numbers were generated by digital 
techniques), but for simulation purposes it may be considered as random. 

This technique may be employed with both analog and digital simula- 
tion methods. With analog methods it is necessary to establish m different 
and independent sine-wave generators (each requiring two integrators and 
one inverter). It is obvious that with analog simulation a considerable amount 
of equipment might be required when this method is used. With digital 
simulation this method places no great demand on computer storage facili- 
ties; however, it does require the program’s “looking up” m sinusoidal 
functions for every time iteration, a somewhat slow process. 

To avoid a pattern repetition during the simulation process, the fre- 
quencies @, to w,, should not bear an integer relationship with each other 
(i.e., they should have no subharmonics in common). With analog techniques 
the fact that the sinusoidal generators are independent will ordinarily guar- 
antee this. With digital generation of random signals by this method, special 
precautions should be observed in this regard. 

As an example, suppose it is found that the frequencies required to 
simulate a given random disturbance are 


@, = 1.65 


It ordinarily would not be satisfactory to employ the above list of frequencies 
directly, expressed to merely two places after the decimal point as listed (in 
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spite of the fact that this represents the highest degree of precision warranted 
by the data). If these specific frequencies were employed, there would be a 
common subharmonic of @ = 0.05 rad/sec and hence a period of pattern 
repetition of 27/0.05 = 31.4 sec. To extend this repetition period by a con- 
siderable factor, the frequencies are expressed to one additional decimal 
place and the last digit is then adjusted so that the complete series of digits 
representing any one frequency (neglecting the decimal point) is a prime 
number. For example, the above list would be modified to 


@,=0.499  w, = 1.753 
@,=1.201 @, = 1.801 
@,=1499 ow, = 1.951 
@, = 1.657 


All the digital sequences listed above [e.g., the numbers 499, 1201, etc.] 
are prime numbers, The only common factor is 0.001; hence this is the basic 
subharmonic, The period of repetition will be 2z/0.001 = 6280 sec. If this 
still should prove to be too short, it would be necessary to express the fre- 
quencies to more decimal places. 

Another question of importance with this method relates to its repeat- 
ability (see Section 9-8). When this is a consideration, analog methods 
employing this technique may not suffice. Even with supposedly the same 
adjustments, the actual frequencies and phase relations produced by the 
various analog sine-wave generators may differ slightly from one run to the 
next because of minor variations in voltage, temperature, etc. Hence, unless 
the runs were unusually short, the random signal produced would not be 
repeated exactly every time a run was made. With the digital generation of 
random signals by this method, on the other hand, the results obtained will 
be exactly repeatable. 

As the number of sinusoids employed, m, is increased indefinitely, 
the probability density of their sum approaches a Gaussian form. This 
results from the central-limit theorem of statistics. In practice, however, it 
can be shown that even a small number of sinusoidal components (e.g., 
m = 10) will result in a reasonably good approximation of a Gaussian 
probability density. 


9-18 Evaluation of Systems Subjected 
to Random Disturbances 


The purpose of applying simulated random disturbances to models of 
systems is almost always for the purpose of comparison (i.e., to compare 
one system technique with another or to determine the optimum adjust- 
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ment of parameters). To accomplish such comparisons, some figure of merit 
or figure of demerit must be established. 

Depending upon the problem, various figures of merit (or demerit) 
are proposed. For example: 


1. The time average value of some function, w(t), or 
ele 
w= lim J (0) ae 


where w(t) is a weighting function. w(t) may represent a favorable 
condition; in this case the maximum obtainable value of the average 
is desired, the average being a figure of merit. It may represent an 
unfavorable condition; then the minimum obtainable average 
value is desired and this average used as a figure of demerit. 

2. The proportion of time that some critical boundary value is exceeded 
by a variable of interest. 

3. The number of times that some critical boundary value is crossed 
by a variable of interest. 


Other criteria might also be employed in other problems. The significance 
of the three types listed above is explained best by example. 

If the problem is one of control, quality is often measured by the control 
error or difference between the ideal value of the output being controlled 
and the actual value; it is this error that is to be minimized. This error, in 
response to stochastic disturbances, will be a function of time and hence 
might be expressed as e(t), What the minimization of e(t) actually means is to 
be established; this depends upon the criterion employed. It would not 
suffice to use e(f) itself as the weighting function w(t), because then the figure 
of demerit corresponding to the integral expression above would be 


We lim 4, f e(t) dt = Ele(s)] 
T-+00 0 

(where £fe(t)] denotes the mean or expected value of e(t)). This integral 
simply corresponds to the average value; making the average value of error 
zero certainly is no indication of satisfactory performance because it does 
not account for large but compensating positive and negative errors. 

A more realistic weighting function sometimes employed is the absolute 
value of the error; i.e., w(t) = | e(t)| and the figure of demerit to be minimized 
is 


ck Lot 
W = lim | le()|de = Elle) 


Another weighting function used still more frequently is based on w(t) = 
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e?(t). The figure of demerit then is 
W =lim+ (" eX(t) dt = Ele%(t)] 
to T Jo 


The figure of demerit thus obtained is the mean-square value of the error. 

All the figures of demerit expressed above correspond to expected 
values of various functions of e(t). These time-averaging relations are based 
upon the error e(f) being an ergodic function of time as this term is defined 
in statistical theory. For our purposes here, it means simply that probability 
averages may be measured in terms of time averages. 

Often, more complex weighting functions are used. In a control system, 
for example, it may be desirable to minimize the error e(r) but not at the 
expense of unreasonable fuel consumption f(t). The weighting function 
might then be some positive definite function of both e(r) and f(t) with proper 
relative weights applied to each of these; it might, for example, be represented 
by a cost function ae*(t) + bf?(t), integrated and averaged over a sufficiently 
long period of time. 

It is not the purpose here to go into details of how the weighting func- 
tion might be selected to constitute an adequate criterion of merit or cost. 
This consideration will vary from one application to the next and consider- 
able judgment and knowledge of the application will be required if a meaning- 
ful cost function is to be developed; without this the most sophisticated and 
elaborate of computer evaluation or optimization programs would produce 
results of little significance. 


9-19 Techniques for Measuring the Time Average 
of a Weighting Function 


The relationship for the time average of a weighting function, 


T 
W = lim | w(0) at = Elw(o 
implies averaging over an interval 7 of infinite duration. In practice, of course, 
this not only is impossible but unnecessary; it merely is necessary that T 
exceed what loosely has been called the statistical averaging time. This time 
can be determined by experiment. 

With analog equipment, averaging is generally accomplished by apply- 
ing the signal representing w(¢) to a low-pass filter. A simple filter, adequate 
for this purpose, has the transfer function 


1 
1+ ts 


where 7, is of the order of the statistical averaging time. With 1, sufficiently 


Sec, 9-19 Measuring the Time Average of a Weighting Function 445 


long, an observation of the filter’s output eventually will indicate (in a time 
interval roughly equal to 10t,) a steady value (if the random disturbance 
applied is truly stationary). This value denotes the average that is desired. 
The analog arrangement for accomplishing this.is pictured in Figure 9-26. 
As stated above, the adjustment of 7, is conducted most easily on an experi- 
mental basis. If t, is too low, the output indication of the average value will 
not settle down but will fluctuate with a significant amplitude. If too high, 
it will take too long a time before the final steady-state value of W is reached. 

With digital simulation it might be thought that finding the average 
value of a function by means of the straightforward arithmetic approach 
(i.e., by summing all values and then dividing by the number of items entered) 
would be adequate. In practice this has several disadvantages when dealing 
with random functions. First, it assumes a stationary random function and 
will not exhibit any lack of this property that might exist. Also, after a certain 
point in the summing operation, which may not have been carried far enough 
to represent an adequate statistical averaging time, the effect of the later 
entries may be partially or completely nullified by roundoff errors. For this 
reason some other averaging technique is preferred. 

One simple and generally adequate averaging technique is simply the 
digital counterpart of the method shown in Figure 9-26. Figure 9-27 is the 
block diagram that corresponds to this analog filter. Because normally 
t, > At, simple rectangular integration, method 1a-1, will suffice to handle 
the time integration indicated. Assuming here that the values of w(t) are 
supplied at some uniform interval At, the block diagram for this digital 
procedure will be as shown in Figure 9-28. 


random 
disturbance 


Simulation 
of system 


variables ath te 5 
of indication 


interest = ts w(t) dt 


voltmeter 
or 
recorder 


w(t) 


FIGURE 9-27 
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W(n) 
FIGURE 9-28 
The actual operation is described by 
(ri) — Wen = 1) + (Atle w(n) (0-56) 


1 + At/t, 
Relation (9-56) represents a relatively simple algorithm that may be used 
for this digital filtering operation. In view of its simplicity, no flow chart is 
shown here and, as a matter of fact, the use of a special subprogram module 
for this purpose would hardly be justified. 


9-20 Optimization of Systems Subject to Random 
Disturbances 


When systems are subject to random disturbances or random variations of 
parameters, these may be simulated by the methods described in this chapter 
Optimum adjustments may then be established, using the methods of Chapter 
8. The cost function will be, at least partially, some average value of the 
weighting function as discussed in the preceding section, although it may 
involve some determinate (nonrandom) factors as well. 

When optimizing adjustments are established under these conditions, 
it is rather important that the specification of the random disturbances be 
repeated exactly for every different adjustment. Otherwise, even after what 
may seem like a sufficiently long averaging time has been used, the actual 
statistical properties of what are supposedly disturbances of the same statis- 
tical nature actually will be sufficiently different so that it will be difficult 
to find a true optimum. In other words, one of the repeatable methods 
mentioned at the start of Section 9-8 should be employed. 


Suggested Problems 


9-1. It has been established that a random disturbance representing the 
instantaneous height of a sea wave, y(t), under a particular situation resulting 
in almost sinusoidal swells has a normal probability density and a power- 
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spectral density given by 

20? 
9,,(@) = o* + 2.040? + 1 
This disturbance is to be represented for the purpose of computer simulation. 

(a) Assume that an analog simulation program is being prepared 
employing a 10 V computer. One volt is to represent one foot of 
instantaneous wave height. A random-signal generator is available 
that produces essentially white noise up to 100 Hz and has an 
essentially normal probability density. The output of this generator 
is adjustable but not calibrated. 

Establish a program for producing a simulation of this 
disturbance. Include a procedure for establishing the proper 
amplitude. 

(b) Assume that a digital-computer simulation program is to be 
prepared and that a source of random numbers is available in 
the computer library ranging from 1 to 9999, These numbers have 
a uniform probability density and may be considered as white 
noise. The iteration interval At is to be 0.001 sec. Prepare a digital 
program for shaping the signal produced by the random-number 
generator so that the result will simulate this sea wave. 


ft?-sec 


9-2. A milling machine feeds the work at a constant rate and the cutter is 
adjusted by an automatic control system to cut for a desired depth (command) 
x, where x = x(t). Considering an ensemble of parts to be machined, it is 
found that the function x is random and can be described by a triangular 
probability density ranging from zero to 0.3 in. as shown in Figure P9-2. 
For this feed speed the time variation of x(t) is described by a power-spectral 
density as follows: 
10s 
@ + 10-4 
This command signal is to be simulated on a computer. 
(a) Assume that an analog simulation program is to be prepared 
using a 100 V computer where | V is to represent a command of 
x(t) = 5 x 10-3 in. The same type of signal generator is available 


®,,.(@) = 0.226(@) + in.?-sec 


(x) 


0.3 


FIGURE P9-2 
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as is described in Problem 9-1(a). Prepare a program for producing 
this simulated signal. 

(b) Assume that a digital simulation program is to be prepared for 
this problem. The same source of random numbers is available as is 
described in Problem 9-1(b). The iteration interval At is to be 10-* 
sec. Prepare a digital program for shaping the signal produced 
by the random-number generator so that the result will simulate 
this sine wave. 


9-3. In Problem 9-1 it has been decided to employ the principle of super- 
posed sinusoidal signals to simulate the sea-wave effect rather than employing 
truly random sources. Because the spectral density is concentrated about 
the frequency @ = 1, it is considered appropriate to employ only five sinu- 
soidal components. Prepare both analog and digital programs for simulating 
x(t) in this manner. The repetition period of the random disturbance produced 
should not be less than 5,000 sec. 


9-4. In an information-transmission system the problem is one of separating 
signal and noise. Some separation is possible because the noise consists of 
sharp impulses of high amplitude but short duration, while the signal is of 
a more continuous nature, Both the signal and noise have essentially normal 
probability densities. The power-spectral density of the noise, n(t), has been 
established as 
2 x 10%? 
@* 4 10!2@? a5 1018 
The useful signal to be transmitted, x(r), is statistically independent and its 
power-spectral density has been established as 
2108 
@* + 108 
It is proposed that the transmission error resulting from noise be reduced 
by simple limiting; i.e., a limiting filter will be employed having an output of 
x(t) + n(¢) when | x(t) + n(¢)| < y, 
y(t) = 9 ¥. when | x(t) + n(t)| > yz 
we when |x(t) + n(t)| < —yz 
where y, is the adjustable limit of the filter. 
The block diagram describing the problem appears in Figure P9-4. 
The difference between the output signal y(t) and the useful input signal 
x(t) is described as the error e(t). The figure of demerit is 
W = Ele*(t)] 


A program is to be prepared to evaluate W as a function of y, so that 
the optimum value of y, might be established. Assume that provisions haye 


®,,(@) = V?-sec 


®,.(@) = V?-sec 
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FIGURE P9-4 


already been made for furnishing the signals x(t) and n(t) with their correct 
power-spectral densities and probability density. 
(a) Prepare an analog program for handling this problem. Assume that 
a 100 V computer is available and that one machine volt corre- 
sponds to one “problem volt.” 
(b) Prepare a digital-computer program for handling this problem. 


9-5. Prepare a digital program that will automatically find the optimum 
conditions for the program done in Problem 9-4. 
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Appendix 9A: 
Data-Smoothing Algorithm 


The subject of data smoothing is part of the broader subject of regression 
analysis used extensively in statistics and many sophisticated techniques have 
been developed.* The method described here, leading to the subprogram 
called SMOOTH, is one of the most elementary methods and is based on 
obtaining the coefficients of an approximating polynomial of a prescribed 
order, L — 1, that will provide the least-mean-squares fit. 

Say that there are N number pairs corresponding to N coordinate 
points relating y to x. It is desired to obtain some polynomial relationship 
F(x) so that f(x) will be the best approximation of y. Just what is meant 
by best depends upon the application, but it is assumed here that the best 
fit will be obtained when the sum of the squares of the discrepancy between 
y and f(x) at each abscissa value x is a minimum. This discrepancy might 
be called d and would be computed as: 


4B, W. Arden, Digital Computing (Reading, Mass.: Addison-Wesley Book Company 
Inc., 1963), Chap, 15. 
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d,= S(%1) maha 
d, = f(%2) — V2 
d, = f(%3) — Ys 
(9A-1) 
d, = f(x) —y 
d, = f(x) — Vn 
The sum of the squares of the discrepancies might then be written as o?: 
N N 
= d= >» (F(x) — Ye]? (9A-2) 


f(x) is to be such that o? is a minimum. As we are restricting f(x) to a 
polynomial form (with no evidence whatsoever that this form is the most 
applicable; it simply is the easiest to use), f(x) may be written as* 


{= ys a,x! (9A-3) 
Relation (9A-2) then becomes 
N L 2 
= ( ax) — ve) = minimum (9A-4) 
k=1\j=1 


These minimum conditions are obtained only if the partial derivative of a” 
with respect to each a, from a, to a,, equals zero; i.e., if 


do* we N sei 2 2 
da, da, 2X (ant vt) 4 
for all values of i from 1 to L, or if 
N L 2 
LAR axf! — on) =i0 (9A-5) 


for all values of i from 1 to L. 
The above may be simplified by omitting the common factor 2 and 
writing it as 


It would be more logical to write f(x) as 
 ayx! 


The form of (9A-3) was used instead because of the subscript limitations of Fortran; these 
limitations do not apply to Algol 60 or PL/I. 
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for all values of i from 1 to L. In the above the order of summation may be 
interchanged: 


L N N 
PH eyxh Met) = Bate Ve (9A-6) 


for all values of i from 1 to L. The above represents Z simultaneous equations 
with ZL unknowns and corresponds to the matrix relationship 


a 
Allele (9A-1) 
ay, 
where A is an L x L matrix, the element in the ith row and jth column being 
Ay = Set ta (9A-8) 
and B is a vector array of L elements where the ithe element would be 
B,= = XE Ve (9A-9) 


As an oversimplified example, suppose that the four abscissa-ordinate pairs 
were 


k Xe Vic 
1 2 1 
2 3 Ps 
3 4 Z 
4 5 4 


as shown in Figure 9A-1 with the points represented by the symbol «. Suppose 
that this set of abscissa-ordinate pairs, presumably obtained from experi- 
mental observation, is to be represented by a quadratic relation (L = 3). 
The matrix relations would then be 


(UY) (ox) Cuxda (Lx) 
(ix) CLxt) (CL x8) |] a2 | = | CL xe) 
(Ux) Cox) Coxiilas,s LCL xky,) 
where 5) represents the summation = Numerically, for this example, this 
fs kel 
4 14 54)fa, 9 


14 54 224])a,|=| 36 
54 224 938]a,| [154 


FIGURE 9A-1 


The solution for these simultaneous equations is 


a, = 1.85 
a, = —0.85 
a, = 0,25 


In other words, f(x) is 
F(x) = 1.85 — 0.85x + 0.25x? 
The smoothed abscissa-ordinate pairs would be 
(2, 1.15), (3, 1.55), (4, 2.45), (5, 3.85) 

These points are shown as the symbol x in Figure 9A-1 with a curve drawn 
through them conforming to f(x), the smoothed relationship. 

The flow diagram used for obtaining A,, and B, from relations (9A-8) 
and (9A-9) is shown in Figure 9A-2. Note that after the matrix A has been 


obtained, the simultaneous subroutine SIMQ is called. This will return the 
array of solutions of the L polynomial coefficients in the array B. 


SUBROUTINE SMOOTH (x, y, L, N, A, B) 


x and y are arrays of dimension N 


do forall terms of the polynomial approx. 


start of summation of B-vector terms 


do for the lower triangle of the A matrix 


Ali, j)=0 


start of summation, A-matrix elements 
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DO k=1toN 


DO i=ltoL 


A(i, /) = AG, j) + Fy*F; 
F; = Fj*x(k) 


B(i) = B(i) + F,*y(k) 


DO i=l1toL-1 


ects 
Ali, /)= Ai, i) 


CALL SIMQ (A, B, L) 


RETURN 


Chap. 9 


do for all number pairs 
start of summation, x‘~! term for i= 1 
do for all rows of the A matrix 


start of summation, x/~! term forj = 1 


do for all columns up to major diagonal 


adding effects of kth data point 
to element Ay 


raising j in x/~! term for next loop 
adding effects of kth data point 
to vector element B; 


raising i in x‘~! term for next loop 


completing upper triangle of the 
symmetrical A matrix 


Subroutine for solving simultaneous 
equations 


B vector now will be the coefficients 
of the approximating polynomial 


FIGURE 9A-2 


Simulation of Distributed- 10 
Parameter Systems— 
Partial Differential Equations 


10-1 Circumstances That Lead to Partial 
Differential Equations 


In all the simulation examples discussed up to now, the systems considered 
have been describable by differential equations involving only one basic 
independent variable. Usually this basic independent variable has been 
time; this fact identifies the problem as a dynamic one. However, time need 
not necessarily be the basic independent variable; in the beam-bending 
example of Chapter 7 it was instead, x, the distance along the beam. 

A number of situations will arise when the differential equations des- 
cribing the system will involve more than one basic independent variable. 
This will lead, of course, to partial differential equations. For example, if 
the beam-bending example of Chapter 9 had been a dynamic rather than 
static one (i.e., if the transient states of the beam when adjusting from one 
load condition to another had been of interest), then the equations describ- 
ing the beam bending would have been functions of both x and the elapsed 
time ¢. Partial differential equations would have been required to describe 
such a situation. 

Partial differential equations are always involved in field problems, 
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such as those describing electrostatic, magnetic, and hydrodynamic fields, 
and in problems of two- or more-dimensional heat flow. As far as dynamic 
simulation is concerned, even a one-dimensional problem will involve partial 
differential equations because of the introduction of time as an additional 
basic independent variable. In addition to the beam-bending example cited 
above, many other types of simulation problems will arise that involve a 
distance variable as well as a time variable. These are generally described 
as distributed-parameter problems for reasons to be clarified by the example 
to follow. 


10-2 Example of a Distributed-Parameter Problem 


All the examples of the preceding chapters were based on /umped parameters. 
Referring back to Figure 1-1, the spring shown there, designated as k, was 
assumed to have negligible mass. If its mass was considered at all, this was 
done in a very approximate manner by attributing one half to the movable 
mass M and one half to the bottom support. For rapid changes of the input 
displacement x, this could lead to significant simulation errors. 

In the spring example the only exact approach is to take into account 
the distributed (in contrast to lumped) nature of the spring mass. Suppose 
that the spring is uniform and that its active portion has a free /ength (length 
under conditions of zero tension or compression) designated as D. Its mass 
will be designated as M,. It will then be said to have a mass distribution of 
m, = M,/D. The spring’s resilience (the inverse of the stiffness k) will be 
R, = 1/k (e.g., in units of inches per pound or centimeters per kilogram), 
and the resilience distribution will be r,, = R,/ D. If any given part of the spring 
is identified by its free-length distance u from a given end (where u = 0), 
u will range from zero to D. An approximate representation of the spring 
could be obtained by dividing D into n increments, each of length Au = 
D/n. The spring would then appear as in Figure 10-1. The spring alone 
would now comprise a 2n-state system and the complete system of Figure 
1-1, a (2n + 1)-state system. The total mass M, and resilience R, have now 
been divided into n-finite increments, AM, =m, Au and AR, =r, Au. 
The force on each AR, segment is designated as f, a positive force indicating 
compression. Including the end connections, there are n + 1 connection 
points; the relative displacements of these points will be designated as x(i), 
with i ranging from zero to n. x(0) corresponds to the displacement of the 
left-hand end of the spring and would be equivalent to simply x in the 
example shown in Figure 1-1. The other x(i) displacements would be arbi- 
trarily called zero when x(0) = 0 and when the spring is in the static state 
with neither tension nor compression forces. 

In Figure 10-1 there might be some question as to whether the mass 
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segment 1 segment 2 segment i segment n 


AR, AR, 
fw 
a —>— — 
x(1) x(2) x(@i-—1) x(i) x(n — 1) x(n) 


FIGURE 10-1 


element AM, or the resilient element AR, should come first in the tandem 
arrangement shown. The decision in regard to this does, of course, affect 
the approximation. However, as n becomes sufficiently large, this decision 
will prove to have negligible effect on the results obtained. 

The compression of the resilient element AR, associated with the ith 
segment will simply be —Ax(i) = x(i — 1) — x(i), or minus the first differ- 
ence of x(i). As the spring is assumed to be obeying Hooke’s law of linearity, 
this compression will be equal to f(i)AR,, or Ax(i) = —f(i)r,Au, or 


Ax) _ _ +, f(i) (10-1) 


where 
Ax(i) = x(i) — x(i — 1) (10-2) 
The net force acting on the mass element AM, associated with the 
ith segment (assuming that a positive force acts to the right) will be —A f(i) = 


f(i—1)— fi). This net force is simply AM, times the acceleration, 
d?x(i — 1)/dt? or Af(i) = —m, Au d?x(i — 1)/dt?, or 


Af@ _ d’x(i — 1) . 

sie ra to) 
where 

AFM =fO= 7¢—)) (10-4) 


Of course, this dividing of the spring into only a finite number of 
segments n will only approximate the true state of affairs; if the mass and 
resilience distributions are continuous, as they would be here, n properly 
should be infinite and Aw should approach the differential du. Then Ax(i) 
and Af(i) will also become differentials, dx and 0 f. Displacement and force 
will now become continuous functions of both u and ¢. As two independent 
variables are involved, it becomes necessary to employ partial derivative 
notation, and relation (10-1) attains.the form 


oe a pf? (10-5) 
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Relation (10-3) attains the form 


0 2 
af = amie (10-6) 


The above set of equations comprises what are known as traveling- 
wave equations and have standard analytic solutions for classical forms of 
disturbances. It can be shown that disturbances in force and velocity will 
propagate along such a spring with a velocity of propagation given by the 
relation 


1 

v= Tiga. (10-7) 
This relation is important because it can be used to establish whether the 
distributed-parameter effect is significant or whether a lumped-parameter 
approximation will suffice. Suppose, for example, that the active portion of 
a given spring weighs 0.1 kg, that it has a stiffness of k = 20.0 kg/cm, and 
that it is 5cm long. Then R, = 1/kg (the gravity constant g enters in the 
relation to convert the mass unit of kilograms to units of force) = 1/(20)(980) 
= 5.1 x 1075 sect/kg. r, = R,/D = (5.1 x 10-5)/5 = 1.02 x 1075 sec?- 
kg-!-cm=!. m, = 0.1/5 = 0.02 kg/cm. Hence 


1 


"» = “71.02 x 10-*)(0.02) 


= 2210 cm/sec 


As D=Scm, it will require D/v, = 5/2210 = 2.26 x 10~? sec for force 
and displacement disturbances to be transmitted the length of the spring. 

If the spring so described is that employed in the example of Chapter 
1, this distributed-parameter effect could be significant. It should be noted 
in that example, employing the lumped-parameter approximation, that the 
undamped natural frequency was 


— kg _ (20)(980) _ 
0, =a) Ose 198 rad/sec 


The significant range of frequencies may be estimated to extend to about 
3e, or 600 rad/sec. At this latter frequency the phase lag introduced by 
this propagation delay will be (600)(2.26 x 10-*) = 1.35 rad (about 77°). 
Such a lag certainly would be significant. Hence, if the spring used in the 
Chapter 1 example is that meeting the description here, the lumped-parameter 
approximation employed in that chapter would be far from valid and, for 
accurate simulation, it would be necessary to take the true, distributed nature 
of the spring mass and resilience into account. 
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10-3 Other Cases in Which Distributed- Parameter 
Situations Occur 


A diagram analogous to that of Figure 10-1 applies when the transmission 
of longitudinal sound waves in a solid or fluid is being considered, provided 
the losses are assumed to be negligible. Hooke’s law is often assumed to apply 
to the compressibility effects; then linear partial differential equations of 
the same form as relations (10-5) and (10-6) are still applicable. This approach 
is the one employed when computing the velocity of sound in various media. 

In the case of gases, the compressibility relations may be approxi- 
mated as linear only when the amplitude of pressure variation is small in 
comparison to the absolute pressures involved. For large pressure ampli- 
tudes, more complicated nonlinear compressibility relations apply. Figure 
10-1 is still applicable as a model (provided thermal losses are neglected) 
but the springs shown in the model now become nonlinear in a nonsym- 
metrical way. Relations of the form of (10-5) and (10-6) no longer describe 
the situation and the analysis is considerably more complex. Computer 
simulation is still feasible, however, as it is relatively simple to take the non- 
linear compressibility relationships into account. 

An electrical transmission line represents another example of a dis- 
tributed-parameter system leading to similar traveling-wave types of differ- 
ential equations. Here the distributed parameters of interest are the series 
inductance per unit length /, the series resistance per unit length r, the shunt 
capacitance per unit length c, and the shunt-leakage conductance per unit 
length g. If such a line were divided into segments of length Au, a lumped- 
parameter approximation of the kth segment would appear as in Figure 
10-2. 

If an analysis similar to that of relations (10-1) to (10-6) is performed 
as Au is allowed to approach the differential du, the partial differential equa- 


i(k —1) i(k) 
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FIGURE 10-2 
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tions that result are 


= ri — ls (10-8) 
# = —ge— oft (10-9) 


For a lossless line where g and r are negligible, these attain the form of 
standard traveling-wave equations. That this is the case may be established 
by comparing these relations with those of relations (10-5) and (10-6), con- 
sidering i analogous to fand e analogous to dx/dt. Hence, by comparison with 
relation (10-7), the velocity of propagation here will be 


v= Te (10-10) 
It can also be shown that / and ¢ will be so related that v, will be equal to 
the velocity of light in the medium in which the line exists. The presence 
of losses (finite g and r) in a real line results in both attenuation effects and 
in a reduction in this velocity. Such attenuation effects are also readily simu- 
lated. 

One of the most important types of simulation problems are those 
involving heat transfer. Nevertheless, it has not been possible to discuss 
the applications of simulation techniques to these problems prior to this 
chapter because all heat-transfer problems inevitably involve distributed- 
parameter effects and lumped-parameter approximations never suffice. 

As an example of a heat-transfer problem, a simplified case might be 
considered where heat is being transmitted through a long thin rod insu- 
lated at its sides. This is illustrated in Figure 10-3, where the temperatures 


cross-sectional 


D 
a A 


AO) —- (er) 
@(0) 6(D) 
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FIGURE 10-3 


are designated by the symbol @ and heat flow (e.g., calories per second or 
Btu per hour) by /. The pertinent properties of the material in the rod are 
the thermal resistivity p and the thermal capacity per unit volume c. These 
will be distributed along the rod and it will be assumed that the rod is homo- 
geneous and hence that this distribution is uniform. The rod may be con- 
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sidered to be divided into n axial sections of length Au = D/n. If the symbols 
used for electrical resistance and capacitance are also used for this problem, 
the kth section of the rod, when so divided, might be represented as shown 
in Figure 10-4, The temperature change over this segment will be 


AO(k) = O(k) — Ak — 1) = —FAuh(k) (10-11) 


The change in heat flow over this segment will be 


d0(k — 1) 


Ah(k) = h(k) — h(k — 1) = —cA Au a 


(10-12) 
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FIGURE 10-4 


If n is considered to approach infinity and Aw to approach du, these relations 
result in the partial differential equations 


06 op ij 
6 _ Bp (10-13) 
dh _ —A@ (10-14) 


These are not traveling-wave equations of the type previously described. 
They do correspond to the equations for an electrical line given in relations 
(10-8) and (10-9) when there is negligible inductance / and negligible con- 
ductance g. These equations are sometimes described as diffusion equations [1] 
because the same form arises in problems having to do with material being 
diffused from one medium to another. When the cross-sectional area A, and 
p and c are constant, analytic solutions of problems involving such equations 
are sometimes feasible. Even then such solutions are difficult; when transform 
methods are applied, nonrational transforms will result. Computer simula- 
tion of such problems usually represents a more practical approach. It 
becomes a must when additional complicating factors are introduced, such 
as a variation of cross-sectional area A, of resistivity p, or of capacitance 
c with the location along the line. 
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10-4 Aritificial-Line Approach 
to Distributed-Parameter Problems 


One of the earliest simulation techniques employed was that applied to the 
analysis and study of electrical transmission lines. Here the actual lines 
being represented involved many miles in length and direct models obviously 
could not be brought into the laboratory. For this reason the idea was pro- 
posed of dividing the line into n sections with each section having attributed 
to it, in a lumped fashion, the parameters pertaining to that 1/nth of the line. 
Circuit models used to represent real lines and constructed in this fashion 
were described as artificial lines. The concept on which they are based may 
be applied, in general, to the simulation of distributed-parameter systems. 

Consider an electrical line, typical of a telephone or power trans- 
mission line, that has uniform parameters r, /, g, and c per unit length. The 
lumped representation of such a line is shown in Figure 10-2; this lumped 
representation becomes more and more valid as Au becomes shorter and 
shorter (and n becomes greater). 

An artificial line could be constructed to simulate the real line by 
connecting in cascade all 1 such sections of the type shown in Figure 10-2. 
Actually, it is found that a better model is obtained if either what are called 
T sections or pi sections are used instead. Such line sections are shown in 
Figure 10-5. When 7 such sections are cascaded, such an artificial line made 
up of T sections can be distinguished from one made up of pi sections only 
by the end terminations. 

The validity of the approximation represented by an artificial line may 
be established roughly by considering a /oss/ess and properly terminated 
version of such a line where g and r are zero and the line is terminated in a 
resistance equal to the characteristic impedance Z,. Z, is given by the relation 


Z= nes (10-15) 


Under such circumstances, an actual uniformly distributed line would result 
simply in a transportation lag (or finite time delay) equal to t, sec. That is, 
if the voltage applied to one end of the line (where u = 0) is e(0) and the 
the voltage at the other end (where u = D) is e(D), these voltages would 
be related by e(D, t) = e(0, t — t,). Relation (10-10) expresses the velocity 
of propagation for such a line; therefore, 


ee — =) j= (10-16) 
5 


If the steady-state frequency response is used as the basis for com- 
paring a real line with its artificial model, it will be found that for the real 
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(a) T section 
i(k — 1) i(k) 


lAu rdu 


(b) pi section 
FIGURE 10-5 


line the output voltage (at u = D) will be related to the input voltage (at 
u = 0) by the phasor relationship 
ED) _ 4)_ 
EO = 1/-ot, (10-17) 
This response may be illustrated by plots of the amplitude and phase response 
versus the frequency , as shown in Figure 10-6. Here the solid lines represent 
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amplitude 
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phase 


FIGURE 10-6 
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the performance of a real line, having a constant amplitude and a phase 
lag proportional to frequency. The artificial line, consisting of 1 lumped 
sections, will have phase and amplitude characteristics as shown (quali- 
tatively) by the dashed-line curves of Figure 10-6. These will substantially 
agree with the actual line until the vicinity of the cutoff frequency @, is 
reached. Upon reaching the vicinity of this frequency, both the amplitude 
and phase characteristics will deviate markedly from those of the actual 
line. Therefore, the artificial line may be considered as a reasonable model 
of the actual line for all frequencies that are somewhat lower than @,. It 
can be shown that this critical frequency @, is given by the relation 
nv. 

(1) >a (10-18) 
where v, is the velocity of propagation and D the length of the line. It is 
particularly significant that , is proportional to n, the number of segments 
used to represent the line. 

Relation (10-10) may be used to estimate the number of artificial-line 
sections required to simulate a distributed-parameter situation with an 
acceptable degree of accuracy. The critical frequency @, should be consider- 
ably larger (e.g., by a factor of 3) than the highest significant frequency being 
considered in the system being simulated. This criterion may be employed 
for not only electrical transmission lines but other distributed-parameter 
problems as well. When the system has significant losses (finite values of 
rand g or their analogs), the velocity of propagation v, appearing in (10-18) 
may still be determined approximately on the basis of neglecting these 
losses and employing such relations as (10-7) or (10-10). It is desirable to 
make the number of segments employed, 7, not only sufficiently large but 
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also not too large. The selection of too large a value for n will use up exces- 
sive components when analog-computer simulation is being considered and 
will result in excessive execution time when digital simulation is considered. 

To establish the computer programs for representing the ” sections of 
an artificial-line approximation of a distributed-parameter system, it first 
will be helpful to consider the block diagrams. Figure 10-7 illustrates the 
scheme used when T-type sections are employed, and Figure 10-8 the scheme 
when pi-type sections are used. It should be noted that the 7-section termina- 
tion leads to a block-diagram configuration where the voltages at the ends 
of the line, e(0) and e(D), must be furnished and where the configuration, 
in turn, furnishes the currents i(0) and i(D). The converse effect is obtained 
with the pi-section terminations shown in Figure 10-8. 


e(0) 


e(n) = e(D) 


i(n) = i(D) 


i(n — 0.5) i(n) 


FIGURE 10-8 


10-5 General Version of the Artificial Line 


In Figure 10-7 voltage at the sending end, e(0), was considered as an input 
or cause, and current at that end, i(0), as an output or effect. To be general, 
let the sending-end input variable be denoted as x and the output variable 
as y. The general relations analogous to relations (10-8) and (10-9) then 
become 


ok — ay — pB (10-19) 
By =x — _ 5a (10-20) 


where, for the artificial electrical-line analog, the following correspondences 
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(indicated by the symbol ~) hold: 

x~r~éeé Bol 

Diet amie & 

avr d~c 
For a lossless (and approximately for a low-loss) system, the velocity of 
propagation v, is, therefore, 

v= TB (10-21) 

The dual relations, based on interchanging the functions of relations (10-19) 


and (10-20), are applicable when the sending-end current is the input and the 
the voltage at that end the output. Then 


xei Bre 

pre yer 

arg 6nl 
The spring represented by Figure 10-1 may also be represented by rela- 
tions (10-19) and (10-20). The time derivative of both sides of relation (10-15) 
must first be taken. Then, if the velocity v at the sending end is considered 


as the input and the force at that end the output, the correspondence will 
be 


x~v 

yas 

a=0 if internal friction of the spring is neglected 

Born 

y=0 if internal friction with respect to stationary members is 
neglected 

o~m, 


If force at the sending end is the input and velocity at that end the output, 
then 


xof 

yr 

a=0 if internal friction with respect to stationary members is 
neglected 

Brym, 


y=0 if internal friction of the spring is neglected 


Onn, 
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The heat-flow equations of relations (10-13) and (10-14) may also use this 
general form. If sending-end temperature is the input and heat flow at that 
end the output, then 


x~@ B=0 
vials pa) 


ant 5 ~cA 


If sending-end heat flow is the input and temperature at that end the output, 
then 


x~h Bread 

~ Pe 2 
Viglen 
«=0 6=0 


A general block diagram for the artificial-line approximation may 
then be drawn by analogy to Figure 10-7 and appears as Figure 10-9. 


x(0.5) 


x(n) 


y(n) 


Lag (2n + 1) 


FIGURE 10-9 


Which of the t'.o forms of variable (signal) is represented as x and 
which as y is arbitrary, except that it is desirable to make this decision in 
such a way that only integrators, not differentiators, will be involved in the 
block-diagram representation of the other system elements to which this 
distributed system is coupled. 


468 Simulation of Distributed-Parameter Systems Chap. 10 


In some instances the variable designated as x, because it is a sending- 
end input, will appear as an output signal at the receiving end of the dis- 
tributed system. It will then be necessary to add another half-section so that 
D =(n-+ 0.5) Au. The lower portion of Figure 10-9 would be replaced by 
the arrangement shown in Figure 10-10, The preceding sections would be 
identical to those of Figure 10-9. 


x(n — 0.5) x(n + 0.5) 


+——— 


y(n — 1) x(n +0.5) 


Lag (2n + 1) Lag (2n + 2) 
x(n — 0.5) 
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FIGURE 10-10 


Consider, for example, a spring—mass system as shown in Figure 10-11. 
A force f,, is applied to the restrained mass as shown. The resulting velocity 
of the mass, v,,, and corresponding displacement are of interest; also of 
interest is the force exerted on the fixed support. If distance along the spring 
free length is measured from left to right, v,, = v(0), f(0) is f,, less M dv,,/dt, 
and the force on the fixed support is f(m). The velocity of the fixed support 
is of course zero [i.e., v(m) = OJ. 


spring with 
distributed 


spring has mass mx 
fixed per unit length, 
support resilience ry, per 

Pe unit length (based 

on free length D) 


FIGURE 10-11 


To include the effect of the lumped mass M without requiring differ- 
entiation, the block diagram representing the mass should appear as shown 
in Figure 10-12. Hence, at the sending end of the spring, the input is v and 
the output /; hence the analogy based on x ~ v and y ~ fis chosen. At the 
receiving end the imposed velocity v(m) = 0 is the input. Hence, as v is the 
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to 


ue) spring 


FIGURE 10-12 


input at both ends, the configuration of Figure 10-9 is applicable. The com- 
plete block diagram representing the system of Figure 10-11 is, therefore, 
as shown in Figure 10-13. 

Figure 10-14 represents an example where, instead, the block-diagram 
arrangement shown in Figure 10-10 is applicable. Here a force f,, is imposed 
on a member (assumed to have negligible mass) connected to one end of 
both the spring and dashpot. The velocity of this member v(0) and of the 
mass Vy, are of interest. On the sending end of the spring (where u = 0), 
the input is the force f,. On the receiving (left-hand) end of the spring, the 
block diagram describing the effect of the mass M must be considered. To 
avoid differentiation, this must be in the form shown in Figure 10-15. Here 
the input at the sending end is the force f(0), while at the receiving end 
it is the velocity v,,. Hence, an extra half-section is necessary and the spring 
must be represented by the diagram of Figure 10-10. 


displacement 
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Block diagram of Figure 
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FIGURE 10-13 
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spring with distributed 
mass 


FIGURE 10-14 


Upper block dia- 
gram of Fig. 10—9 
and diagram of 
Fig. 10-10 with 
u=Di(nt+ eS) 
a=0 y=0 
B=r_p 5=1, 


FIGURE 10-15 


10-6 Example: Problem of Chapter 1 
with Spring—Mass Distributed 


This example refers back to that pictured in Figure 1-1 with, however, one 
additional provision: the distributed nature of the spring-mass shall now 
be taken into account. The numerical constants of the spring will be assumed 
to be those considered in Section 10-2. Then 


M,=01kg R,=5.1 x 10-Ssec/kg D=S5cm 
and spring friction is neglected. Hence 
m, = 0.02 kg/cm r, = 1.02 x 10° sec?/kg-cm 


In the example of Chapter 1, x was the displacement of the lower 
support and y was the displacement of M. These will be written as x and y 
here to distinguish these symbols from the x and y used in the sense shown 
by Figures 10-9 and 10-10. The block-diagram representation for this prob- 
lem is shown in Figure 10-16. This may be used as the basis of either an 
analog or digital program. Conversion to an analog program needs no further 
explanation; for a digital program the use of a general transmission-line 
module is explained in the section to follow. 

Relation (10-18) may be used to determine the number of line segments 
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Figure 10—9 model 
of spring with Au 
=D/n 

a=0 y=0 
Bar, 5=mx/g 


fi0) Note: Normally, 5 would simply be mx; 
not however, because of the inconsistent 
needed units of this problem, 6 = mx/g 
FIGURE 10-16 


that are required. The velocity of propagation has already been determined 
in Section 10-2 as 2210 cm/sec. [Had it not been, it could have been deter- 
mined from relation (10-21) by substituting r, for B and m,/g for 5.] The 
undamped natural frequency of this system, prior to considering the effect 
of the spring-mass, was computed as w, = ./kg/M = 198 rad/sec. It will 
be desirable to reproduce faithfully the effects of disturbances having fre- 
quency content up to about three times this frequency or, roughly, up to 
600 rad/sec. In turn, the critical frequency @, should be about three times this 
higher disturbance frequency or about 1800 rad/sec. From relation (10-18), 
o.= naz) = 442n 

Hence five sections would appear to be sufficient. With digital simulation 
there is less pressure to maintain the number of sections at this minimum 
because no additional equipment becomes required by being overgenerous; 
of course, increased time of execution would be the result. 


10-7 General-Purpose Module 
for Transmission-Line-Type Problems 


Figures 10-9 and 10-10 may be used as the general bases for modules for 
handling such transmission-line types of simulation problems, regardless of 
whether they are of an electrical, mechanical, hydraulic, or thermal type. 
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(With the hydraulic type provision generally has to be made for a nonlinear 
r) 

The time-lag blocks of Figures 10-9 and 10-10 should be redrawn 
first in terms of the inputs to the required integrators. For this purpose the 
following total parameters are defined: 


A=aD B=£fD 


10-22 
T=yD A=6D ( ) 


The analogs to actual transmission-line situations are shown in Table 10-1. 


TABLE 10-1 
Parameter Electrical, x ~ e,y~i Spring, x ~v,y~f 

A Total resistance, R = rD Total internal friction of spring 
material 

B Total inductance, L = /D Total resilience, Ry =1r,.D 

iy Total conductance, G = gD Total friction with respect to outside 
members 

A Total capacitance, C = cD Total mass, My = m,D 


The lag blocks of Figures 10-9 and 10-10 then become as shown in Figures 
10-17 and 10-18. 

A subprogram to represent, in general, any transmission-line type of 
system, called LINE, has been prepared; its flow diagram is shown in Figure 
10-19, It possesses the following arguments in common with the calling 
program: 


n The number of line sections to be used 
HALF True if an extra half-section is used; otherwise false 
NEW Made initially true by calling program, to set constants 


and initial integrator outputs 
A, B,T,A The total parameters 


Xo: Vo Input and output variables at the sending end 

XaiVip Input and output variables at the receiving end 

INTIN The array of integrator inputs developed by this sub- 
program 

INTOUT The array of integrator outputs developed by this 
subprogram 


LASTINT See explanation below 


In the integration module, all integrators, whether used to represent 
this transmission line or for other parts of the program, are subscripted and 
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for /= 1 and, for B=0 
Fig. 10—9 config- in above, ny =n for Figure 10 — 9 
uration, for configuration, and =n + 0.5 for 
i=2n+1 Figure 10—10 configuration 
FIGURE 10-17 


each pass of the integration routine then handles these sequentially. Other 
integrators may be employed in the overall program, hence the i = 1 inte- 
grator developing y, is not necessarily integrator 1. All integrators not 
involved within the line simulation are assigned subscripts first: LASTINT 
is the last subscript so assigned. Hence integration operation i will be handled 
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For Lag i with i Even 


(For Fig. 10—10 configuration, num- 
erator factor is 2 when i= 2n + 2) 
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by the integrator subscripted (LASTINT+/). Hence, when i is odd, 


INTOUT(LASTINT+i) = (5) 
When 7 is even, 


INTOUT(LASTINT+i) = x(# 5 +) 
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SUBROUTINE LINE (n, HALF, LASTINT, A, B, P, A, NEW, 
Xo. Xas Yor Yas INTIN, INTOUT) 


LOGICAL: HALF, NEW 
REAL ARRAYS: INTIN, 
OUT 


number of intervals 
into which line 
is divided 


input transfer con- 
stants to integra- 
tors 


Cy = ng/B; Cy = A/B;C = nglA;C, = T/A 


XGRAD = (xy — x9)/ng 
YGRAD =(y,— ¥,)/n4 


initial gradient of x and 
y with respect to intervals 


INTOUT(LASTINT)+ 1) =) initial y, 


DO fork=1ton 


NEXT = LASTINT + 2k 


linear interpolation to: 

initialize from x(0.5) to 
x(n— 0.5) 

initialize from y(1) to 
y(n) 


INOUT(NEXT) = xg +(k — 0.5)* XGRAD 
INOUT(NEXT + 1) = yg +k*YGRAD 


FIGURE 10-19 


INTOUT(LASTINT + 2N + 2 


NEW = false 


RETURN 

input to in- 
tegrator pro- 
ducing Yo 


INTIN(LASTINT + 1) = 2C, *(x9 — INTOUT(LASTINT + 2)) 
— 2C, *INTOUT(LASTINT + 1) 


DO fork=1ton 


inputs to in- 
ducing x (0.5) 
to x(n — 0.5) 


INTIN(NEXT) = C; *(INTOUT(NEXT — 1) — INTOUT(NEXT + 1)) 
— Cy, *INTOUT(NEXT) 


INTIN(NEXT + 1) = C, *(INTOUT(NEXT) — INTOUT(NEXT + 2)) 
— C,*INTOUT(NEXT + 1) 


input to in- 
tegrators 
producing 
YC) to y(n) 


FIGURE 10-19 (cont'd) 
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INTIN(NEXT + 1) = 2C, *(INTOUT(NEXT) ~ xq) 
— C, *INTOUT(NEXT + 1) 


input to inte- 
grator producing 
Dkr) ata 


INTIN(NEXT + 1) = C, *(INTOUT(NEXT) ~ INTOUT(NEXT + 2)) input to in- 
~ C, *INTOUT(NEXT + 1) yee hee 
ducing y(n) 
input to inte- 


INTIN(NEXT + 2) = 2C, *(INTOUT(NEXT + 1) — ya) 


2C, *INTOUT(NEXT + 2) Beaton DICducing 


x(n + 0.5) = xy 


RETURN 


FIGURE 10-19 (cont'd) 


At the start of the program, NEW is made true by the calling program 
prior to starting the time iterations. At that time operation branches to the 
upper part of the flow diagram shown in Figure 10-18. The value of n, (see 
Figures 10-17 and 10-18) is first established. Then the transfer constants 
establishing the integrator inputs, named C, to C,, are computed. 

The initial values of the integrator outputs at the ends of the line, 
Xo, {to} X» and y,, will have to be established by the main program. The 
initial values of all other integrator outputs used in representing the line 
will have to be established as well. Their distribution is initially assumed to 
be linear (i.e., the x’s may be determined by interpolating between x, and 
x, and the y’s) between y, and y,. (The program may be modified if this 
linear assumption is not the case.) 

After all the above has been done prior to the actual time iterations, 
NEW is made false by the LINE subroutine and control returned to the main 
calling program. The LINE subroutine will be called again when t = 0 and 
then at each successive integration pass. 

In summary, the major function of this subroutine is to establish the 
new integrator inputs at each iteration interval. The general configuration 
of a main program that would call such a subroutine is shown in Figure 
10-20, 
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Read n, At, Atos and other instructions 
required by other aspects of the problem 

Read the values of the parameters 
that establish A, B, I’, and A 


Read all pertinent initial con- 
ditions, including initial values 
of variables at ends of line 


NEW = true 
HALF is specified 
LASTINT is specified 
All other logical values 
needed for integrators and 
other modules are specified 


Any other initialization required 
by other aspects of the problem 


CALL the LINE subprogram 


executed 


iterative return 


FIGURE 10-20 


Chap. 10 


upper portion of Figure 
10-19 flow diagram is 


NEW made false by subroutine 
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Establish the new values 
of any time-variable para- 
meters and variables 


Establish inputs to line: 
x(0) and x(n) if HALF is false; 
x(0) and y(n + 0.5) if HALF is true 


new inputs to inte- 


grators used in LINE 
will be established. 


CALL the LINE subprogram| 


Establish the inputs to 
all other integrators 


Compute the value of 
any other variables 
required in output 


Print ¢ and all 


variables of interest 


FIGURE 10-20 (cont'd) 


CALL integration subroutine 


FIGURE 10-20 (cont'd) 


10-8 Application of the LINE Module to Simulation 
of the Problem of Section 10-6 


In Section 10-6 we discussed the Chapter 1 example with the distributed mass 
of the spring taken into account. The block diagram of Figure 10-16 is the 
basis of the simulation. The digital program used is shown in flow-diagram 
form in Figure 10-21. 

In this program integrator 1 develops y and integrator 2 develops y. 
Hence LASTINT = 2. The next 2 + 1 integrators represent the line (i.e., 
the spring). Therefore, 2n + 3 integrators ordinarily would be needed. As 
an afterthought, a printout of the displacement y,,;, of the spring midpoint 
was also considered to be of interest. However, while the (n + 3)th integrator 
does produce the associated velocity ¥,;, this displacement y,,,4 itself is 
not directly available. Hence still one more integrator, 2n + 4, is required. 

The XFUNC program to be used is the same as that associated with 
the results shown in Chapter 1 (i.e., a simple ramp function applied at 
t = 0). However, for t < 0, x = 0; for t = 0, x will have the value associated 
with the ramp’s slope. For the velocities of the various points on the spring 
to be properly interpolated so that they will all be initially at rest (as is 
assumed to be the case in this problem), x is set to zero and the zero value 
of y also is read in. After this, the first call is made on the LINE subprogram 
(with NEW = true). Only after this is the first call made on the XFUNC sub- 
routine for initial calibration purposes. 

The rest of the program is straightforward. The results are shown 
plotted in Figure 10-22. The number of sections used for this example was 
33, far more than the minimum number of five discussed in Section 10-6. 

In Figure 10-22 the change in the simulated displacement response 
y caused by taking the distributed effects into account does not appear to 
be especially striking. This change is much more apparent if the spring force 
Ji, a8 it appears at the end where the mass M is attached, is plotted instead, 
as in Figure 10-23, It may be seen that the distributed-parameter effect would 
be particularly important to someone concerned with the peak spring stresses 
incurred in such a situation. 

For this simulation, using the four-pass Runge-Kutta type of numerical 
integration (4A-1), a At of 0.0005 was required in order to obtain reasonable 
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Read k, M, m, listing of equivalent 
Print k, M, my variables: 
INTOUT (1), y 


INTOUT (2), y 

INTIN (1), dy/dt 

INTIN (2), ¥ 

INTOUT (3), fy 
INTOUT (2n + 3), fy 
INTOUT (n+ 3),¥ mia 
INTIN (2n + 4), dYmmja/dt 
INTOUT (2n + 4), Ynia 


read constants 


Read B, At, Ati fax st» LAST; 


print B,n, At 


read 
parameters 


for XFUNC sub. CAL = true 


req, no. of STATE = 2n+4 
integrators LASTINT =2 
(g/M) = 980/M 


HALF = false 


time 
initialization 


initial values 


to set integrators it is ne- 
cessary to assume x = 0 fort <0 


deflection, middle of spring 


static equilibrium of spring 
is assumed for ¢ <0 


B= fd of Figure 10—16 

distr, friction with outside 
members, A = 0 

internal spring friction, f = 0 


A= 6d of Figure 10-16 


(m,/g) = m,/8 


initialization of 
logical variables nd PR 

note difference in sig- 
nificance of symbol x 
here and x in parameter 
list for LINE 


NEW = true; NEWDT = true; 
LASTPASS = true; NEWTIME = true 


FIGURE 10-21 


u 
CALL LINE(N, HALF, LASTINT, bx, , ry 


bk,» (mj /g), NEW, mY Ik os fy 
INTIN, INTOUT) 


CALL XFUNC(CAL, t, x,y) 


CAL = false 
Print headings for output listing 


iterative portion starts 


no yes 


' CALL XFUNC(CAL, t,x,x) 


CALL LINE(n, HALF, LASTINT, by, . t inputs are estab- 
bk,» (m, /g), NEW, x,y, fig: ie lished for the 


(2n + 1) integra- 
INTIN, INTOUT) tors used for 


updated values 
of x,x 


Sg = B(X—Y) 
¥=(g/M)Sy +f, —M) 
dy/dt=y 
AY mig (At = Yonig 


establishing other 
integrator inputs 


FIGURE 10-21 (cont'd) 
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CALL INT(STATE, At, t, NEWDT, 
LASTPASS, NEWTIME, INTIN, 
INTOUT) 


FIGURE 10-21 (cont'd) 


x isramp function applied at ¢ = 0 with 
slope of 100 cm/sec 

k=20.0 kg/cm B=0.050 kg/cm/sec 

M=0.350kg =m, = 0.300 kg 


// —— distributed nature of 
spring considered 


—— distributed nature of 
spring not considered 
(Chapter | results) 


0 0.01 0.02 0.03 0.04 0.05 


t, sec 


FIGURE 10-22 
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x is ramp function applied at ¢ = 0 with slope 
of 100 cm/sec 


k=20.0kg/em 8 =0,050 kg/cm/sec 
M=0.350 kg mx = 0.300 kg 


Sky ke 


distributed nature of 

spring considered 
————distributed nature of 
spring not considered 


—20 


FIGURE 10-23 


accuracy, as compared with the much coarser interval permissible when the 
spring was considered as a lumped resilience with half of its mass lumped 
at each end. The required iteration interval is approximately proportional 
to 1/n. Since execution time per iteration is roughly proportional to n (for 
n> 1), total execution time will then tend to be proportional to the square 
of the number of sections used. This indicates the importance of selecting n 
with as low as possible a value consistent with accuracy. 


10-9 Transport Lags or Finite Time Delays 


In Section 10-4 a lossless electrical line was discussed that was terminated 
by its characteristic impedance. Under such circumstances disturbances 
applied at one end, say x(t), will appear at the other end as, say y(¢), in such 
a way that 

WO) = x(t — 44) (10-23) 
where ¢, is the transport lag, or finite time delay, that was introduced. For 
this lossless electrical line the value of t, is given by relation (10-16). It may 
be noted that the result y(t) will be an exact replica of x(t) except for this 


delay. 
Similar phenomena occur in other types of physical systems. Distur- 
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bances in a hydraulic line will travel at the speed of sound (for the medium 
involved); if the line is terminated in a hydraulic resistance equal to its 
characteristic impedance there will be no reflections (the cause of water- 
hammer effects) and, again, disturbances applied to one end will appear as 
an exact replica at the other except for this time delay. Many other forms of 
transport lag exist because of distributed-parameter effects. Another example 
where time delays are important is the earth control of a space vehicle. Radio 
signals between earth and the vehicle will travel at the velocity of light (essen- 
tially because of a distributed-parameter effect). Hence important time 
delays will be apparent in such a control problem. In general, time delays 
cause serious difficulties in control problems and are best avoided or mini- 
mized. However, this is not always possible. In any event, because of their 
significance, it is important that they be simulated properly. 

The examples mentioned up to this point related to time delays result- 
ing from distributed-parameter effects. This is not the only cause; in fact, 
the alternative term, transport lag, implies that they arise from transport 
phenomena as well. Processes being simulated will be subject to such lags 
whenever transport is part of the process, as in conveyor-belt or flow opera- 
tions. Traffic-control problems, often simulated, always involve such delays 
because of the time required for a vehicle to travel from one point to another. 
Heat transmission by convection (as opposed to transmission by conduction, 
discussed in Section 10-3) involves the transport lag of the convecting 
medium. 

Finite time delays, or transport lags, are usually unwelcome but 
unavoidable effects to one responsible for preparing a computer simulation 
program. This is particularly the case when analog simulation is contem- 
plated, since no completely satisfactory analog method for simulating such 
effects has been developed. The problem is a simpler one when digital- 
computer simulation is contemplated, but an objection arises again because 
of the excessive demand that is likely to be placed on the computer’s storage 
facilities, Unfortunately, just those instances when the time delay poses the 
most severe simulation problems are also those where this time-delay effect 
is the most significant. Hence the problem cannot usually be “ducked,” 
but must be faced in as satisfactory as possible a manner with the equipment 
that is available. 


10-10 Analog Simulation of Finite Time Delays 


Relation (10-23) described the input-output relationship represented by a 
finite time delay. In operational or transform notation, this would correspond 
to 


Y(s) = X(s)e"* (10-24) 
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The transfer function e~“* describing this effect is nonrational. The effect 
cannot be synthesized exactly by any arrangement employing a finite number 
of lumped elements. 

A large number of methods have been proposed for simulating time 
delays on an analog computer. The four basic methods that are used most 
frequently are 


1. Sampling and capacitor storage. 

2. Magnetic-tape storage. 

3. Simulation of a properly terminated distortionless line. 
4. Padé approximations. 


The first method simply involves sampling and holding the input x(t) 
at specified time intervals At and then reading them out f, later. In this 
respect the method is basically the same that is used with digital simulation, 
to be discussed in the next section. Various mechanisms have been proposed 
for this purpose. One of these consists of connecting a large number of 
capacitors to commutator segments; the other terminal of each capacitor is 
grounded. A recording brush applies the signal x(t) to each capacitor in turn 
as its commutator segment engages the brush, thus charging it so that it 
will hold that voltage. This holding operation is continued until the capa- 
citor’s commutator segment is engaged by a playback brush, which applies 
the stored voltage to an output amplifier. The speed of commutator rotation 
and the spacing between the recording and playback brushes establishes 
the value of f,. 

Method 2 is essentially a continuous version of the above scheme 
which avoids the time-sampling effect. A continuous belt of magnetic tape 
first engages a recording head that applies the signal x(t) and later engages 
a playback head that reads the signal y(t). The speed of the tape and the 
spacing between recording and playback heads determine ¢,. Unfortunately, 
a number of practical problems enter into the implementation of this scheme 
so that, although it performs very satisfactorily, it does require complicated, 
bulky, and expensive equipment. First, the mechanical problems involved 
for obtaining a value of ¢, continuously adjustable over a wide range are 
obvious. Second, it should be pointed out that magnetic-tape recording is 
not sufficiently faithful to reproduce analog voltages directly. As a result, 
frequency-modulation methods are necessary to provide sufficient accuracy. 
This means that the signal x(t) must be converted to a frequency-modulated 
form before being applied to the recording head, and that the signal obtained 
from the playback head must be demodulated before it appears as y(¢). 
Commercially furnished equipment is available for this purpose to supple- 
ment analog-computer installations. However, none of this equipment is 
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inexpensive; this presents an especially serious problem when a number of 
finite time delays must be simulated. 

Method 3 is based on the analog of what is called a distortionless elec- 
trical line. Because the basic principles of its development are somewhat 
detailed, the explanation is postponed to Appendix 10A. The basic block 
diagram describing the application of this method is shown in Figure 10-24. 
From that block diagram, an analog-computer program may readily be 
synthesized. One version would appear as in Figure 10-25. This method is 
probably the most satisfactory known for simulating finite time delays, 
provided n, the number of sections employed, is sufficiently great. Its one 
disadvantage is that it is somewhat wasteful of integrators. 

Method 4 employs the Padé approximation [2]. The transfer function 
Y(s)/X(s) = e- is approximated by the following form: 


Y(s) _ N(s) 


¥@) = De) (10-25) 
where, for an nth-order approximation, 
tas , m(n—1) (ts)? 
DE)=1b 4 + aan 1) ot 
eee Mttl) ae (nS TEEN) ees)! 
@n)Qn—1)---Qn—i+]) i! 
n! 55 
Wer Onyi ts) (10-26) 
and 
Ms) = D(—s) (10-27) 
For example, for the fourth-order Padé approximation, 
1 — a 4 3(tys)? (tas)? (tas)* 
Y(s) pr aa 84" 1680 (10-28) 
X(s) 14 8 4 3(tas)? (tas) 4 Wes)" 
2 we " ee | 16s0 


When viewed in terms of frequency response, it may be noted that the mag- 
nitude of Y(ja)/X(ja) is always unity, agreeing exactly with that of the actual 
function being approximated, e~/"”. The only approximation error relates to 
phase. For the fourth-order approximation, given above, the phase response 
is reasonably faithful for frequencies up to about t, = 5. 

A fair basis of comparison between the Padé approximation and the 
artificial version of a distortionless line, just discussed previously, would be 
on the basis of assuming the same number of integrators are available in 
either instance. For example, the artificial-line simulation of Figure 10-25 
will employ (2n + 1) integrators; hence, for n= 5, 11 integrators are 


Q 


a — (u)x 


s(u/PI) +1 


I 


v2-OL 3YNDIS 


(SO 


— ux 


488 


Sec, 10-17 Digital Simulation of Finite Time Delays 489 


x(r) 


+y(t) for +y(t) for 
n even n odd 


FIGURE 10-25 


required. Therefore, such a fifth-order artificial-line simulation should be 
compared with an eleventh-order Padé approximation. 

In general, which technique is superior will depend upon the type of 
simulation problem encountered. Characteristic of the Padé approximation 
is the tendency for significant output, y(¢), effects to appear almost imme- 
diately after the application of a step-function input x(t). This does not occur 
with the artificial-line technique. There, as Figures 10A-2 and 10A-4 show, 
no significant output effects appear at all for a substantial portion of the 
interval 0 < t <1, When this latter feature is desirable, method 3 does 
appear to be somewhat superior. This particularly will be the case when 
markedly nonlinear elements, as contactors, follow the time-delay effect. 


10-11 Digital Simulation of Finite Time Delays 


Because the digital simulator operates on a sampling basis, no particular 
problems other than those regarding storage requirements are encountered 
when producing a finite time-delay simulation by digital means. The values 
of the lag input x(t) are stored for every normal iteration interval At. Enough 
values must be stored so that the range of the time delay 1, is covered. 

A very simple example, say t, = 0.045 sec and a normal iteration 
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interval of At = 0.02 sec, will be employed. Then, 0.045/0.02 = 2.25 storage 
elements are needed—in practice three elements would be employed in a 
chain. These could be indicated as shown in Figure 10-26. In addition, a 
storage element named y,,,, is shown reserved to receive the value of y that 
will apply at the next iteration interval. 


u(1) u(2) u(3) 


Ynext FIGURE 10-26 


Before actual simulation, while in the calibrate mode, element u(3) 


would be loaded with the value of x at t = —0.02 sec, element u(2) with the 
value at t = —0.04 sec, and element u(1) with the value at t = —0.06 sec. 
Say, for example, that 

x=0 t< 0.02 


=2-+ 100t t> 0,02 


so that x(t) plots as the linear function shown in Figure 10-27. The resulting 
values of y are also shown plotted in Figure 10-27. 


—0,02—-0.01 0 0,01 0.02 0.03 0.04 


FIGURE 10-27 
The initial values held by the memory locations would appear as in 
Figure 10-28. The interpolation relationship used is 
Vaexe = 0.25u(1) + 0.75u(2) 


and, in this example, the result will equal zero. 
At ¢ = 0, the first iteration of simulation y, the delayed output, is set 
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u(1) u(2) u(3) 
x(—0.06) x(—0.04) x(—0.02) 


FIGURE 10-28 Ynext 


equal to nex, and hence to zero [i.e., y(0) = 0]. Memory location u(1) is 
set to the value x(0). Yaex: is reset by the interpolation relationship 
Vaext = 0.25u(2) + 0.75u(3) 


The result will still be zero. These procedures are shown in Figure 10-29. 


x(0) 
u(1) u(2) u(3) 
2 
9 
x(0) x(—0.04) x(—0.02) 
FIGURE 10-29 Ynoxt 


At t = 0.02, the next iteration of simulation, y, is again set to Voext 
happening to remain zero in this example [i.e., (0.02) = 0]. Memory loca- 
tion u(2) is set to the value of x(0.02). Yrex i8 reset by the interpolation rela- 
tionship 


Vaext = 0.25u(3) + 0.75u(1) 
The result will be y,.x, = 1.5. Note the recycling. The above-described pro- 


cedures are shown in Figure 10-30. 
At t = 0,04, the next iteration of simulation y is again set equal to 
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(0,02) 
u(1) u(2) u(3) 
4 
2 
x(0) x(0.02) x(-0,02) 


Ynext 


FIGURE 10-30 


Vaexts happening to be 1.5 in this example [i.e., y(0.04) = 1.5]. Memory loca- 
tion u(3) is set to the value of x(0.04). yx, is reset by the interpolation rela- 
tionship 

Vaext = 0.25u(1) + 0.75u(2) 
The result will be y,.., = 3.5. Note that the recycling continues. The above- 
described procedures are shown in Figure 10-31. 


x(0.04) 


u(l) u(2) u(3) 


x(0) x(0.02) (0,04) 


interpolation 


FIGURE 10-31 


At t = 0.06, y is again set to y,,.,, happening to be 3.5 in the example 
[i.e., (0.06) = 3.5]. Memory location u(1) is set to the value of x(0.06). 
Ynext iS reset by the interpolation relationship 


Vaoxe = 0.25u(2) + 0.75u(3) 
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The result will be y,.., = 5.5. Note that the recycling has now been com- 
pleted. The above-described procedures are shown in Figure 10-32. 

Let K denote the index of the u element used for storing the present 
value of x. L and M would then be the next successive elements. (However, 
if K =n — 1, thenL = nand M = 1. Also, if K = n, thenL = land M = 2. 
This effects the resequencing operation.) The interpolation relation is 


Vnext = C,u(L) + c,u(M) 


x(0,06) 
u(1) u(2) u(3) 


8 
Z 


x(0.06) x(0,02) (0.04) 


interpolation 


Vnext 
FIGURE 10-32 
where 
t 
= ft—-~—1) 
e¢,=1l—¢, 
and 


= fa 
n= TRUNC 34 + 1 


TRUNC is the operation that truncates a quantity to the highest integer value 
contained within it. For the example just given the following values would 
have been obtained: 


n=3 ¢, = 0.25 ¢, = 0.75 


In instances when ¢, is an integer number of At’s, interpolation is not neces- 
sary. Then 


ce, =1 ez, =0 nae 


~ At 
It is convenient to have a standard subprogram handle such finite 
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time delays. Figure 10-33 is a flow diagram for such a program, called TLAG. 
This program is designed to handle a number (LAGS) of such delays, Hence 
X,Y, N, ¢,,¢,,and IN will be arrays, subscripted in terms of which lag is 
involved. (IN is the order number of the next memory element to be loaded 
with the present value of x.) The storage elements described as u will have 
double subscripts, first in terms of the lag involved, and second in terms of 
the order number of the element. 

Most of Figure 10-33 is self-explanatory in view of the preceding 
discussion and example. However, the situation of a comparator search or 
of an intermediate pass in the integration procedure should also be con- 
sidered. Under these conditions, the value of x should not be stored in the 
memory elements. However, unless time has not changed (NEWTIME = 
false), the delayed values of y during these irregular time increments must 
still be computed by extrapolation. The procedure for this is shown in 
Figure 10-33a. Note that, for this purpose, the value of y established for the 
last regular iteration interval must be saved as y,,y. This also is the reason 
why it was necessary to compute the delayed output one interval in advance, 
AS Vaext: The value of y,.,, is needed for purposes of interpolation. 

The calling program should include the statements, LASTPASS = true 
and NEWTIME = true, even though no integration is involved; it should 
include the statement, STATUS=1, even though no comparators are involved. 
To illustrate TLAG, the example of the next section will be used. 


10-12 Example of a Control Loop 
with a Finite Time Delay 


Figure 10-34 is an example of a very simple control system susceptible to 
easy pencil-and-paper analysis that might be used to check the results pro- 
duced by the TLAG subprogram. It is assumed that a unit step-function input 
r(t) is applied. (As the system is linear, there is no need to try step inputs 
of other magnitudes.) It is also assumed that c(0) is zero. The results of this 
program may be checked, as it is simple to show that the system becomes 
unstable when the gain K is equal to the value 2/2r,. Under these circum- 
stances it will exhibit steady-state oscillations at a frequency f,,, = 1/4t, 
(i.e., the period of oscillations will equal 4t,). The flow diagram for the pro- 
gram to simulate this situation is shown in Figure 10-35. 

The only subroutines required are TLAG and INTEGRATE. The major 
point of the program is to note the change in response as K is varied. If 
the program is correct, steady-state oscillations should be observed when 
K = n/2t,, as was stated above. 
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SUBROUTINE TLAG(LAGS, CALIBRATE, u, At, ty, t, x, y, STATUS, LASTPASS, NEWTIME) 


i represents the order 
number of each lag 


CALIBRATE 
9 wis an array dimen- 
sioned (a, b) where 
a is number of lags 
involved and b is 
maximum n(i) 


DOi= 1 to LAGS 


spaces = fg(i)/At 
n(i) = TRUNC (spaces) 
¢, (i) = spaces — n(i) 


— 


fractional 


Space INTERP (i) = true 
negligible n@=a@+1 


e @=1—c() 
INTERP (i) = false 


fas, Vs Ynows 
Ynext» 1» €2sIN, 
INTERP are arrays 
dimensioned (a) 


A comparator 


no inter- ah 
i Yoext = 1 uli, 2) 
eee +e,(iu(i, 3) 


integration step 
not complete 


IN is number 
of element 
where x is 
stored; will 
be advanced 
to | when 


IN (i) = 0 


do not 


store 
uM x but do 
interpo- thas not 
late to changed 
find y 


RETURN RETURN 


FIGURE 10-33 
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AAt = t — troy 
ay = AAt/dt 
a,=1—a, 


DOi=1 to LAGS 


YM) = 4 Ynow + 42 ¥ next O 


RETURN 


normal Ar 
and actual 
end of 
interval 


DOi=1 to LAGS 


to save y(i) in case in- 
terpolation is needed during 
comparator search or during 
an intermediate integration 
pass 


advance the order number 
of the element where value 
of x is stored 


FIGURE 10-33 (cont'd) 
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this handles 
recycling 


ec, (uli, L) 
) 


+c, (i)u 


store next x(i) 


advance pointer by 1 


RETURN 


FIGURE 10-33 (cont'd) 


e(t) 


FIGURE 10-34 
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LOGICAL: LASTPASS, NEWTIME 
CALIBRATE, MORE, NEWDT 


INTEGER: STATES 


the dimension a is chosen to 
agree with that used in TLAG 


b should be an integer greater 
than the maximum value of 
(tq/At + 1), ie. the number 
of memory locations needed 


u is an array dimensioned (a, b) 
€, m, tq, are arrays dimen- 
sioned (a) 


CALIBRATE = true 


Chap. 10 


Read fq (1), At, Apt, tmax 


DELTAT = Ar 


Read K, MORE 
initialization 
for integration 


LASTPASS = true; NEWTIME = true; 
NEWDT = true; STATE = 1 


further initialization 
for lag 


LAGS=1; STATUS=1 


initial conditions 


unit step function r(t) 
applied; initial controlled 
output = 0 


FIGURE 10-35 
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CALL TLAG(LAGS, CALIBRATE, u, At, 
tg, e, m STATUS, LASTPASS, NEWTIME 


CALIBRATE = false 


iterative return 


CALL TLAG(LAGS, CALIBRATE, u, At, 
ta, e, m STATUS, LASTPASS, NEWTIME, 


true 


return 
for new 
run 


CALL INTEGRATE (STATE, LASTPASS, 
NEWTIME, NEWDT, t, Av, ¢. c) 


iterative return 


FIGURE 10-35 (cont'd) 
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Suggested Problems 


10-1. If the surface of a section of ground is flat and level, it is subjected to 
a uniform surface temperature, and if the soil below is homogeneous (a 
considerable “if”), Figure 10-3 will apply to 1 ft? of surface. u is depth below 
the surface. For | ft? the thermal constants referred to in Section 10-3 are 


c = 44(Btu/°F)/ft p = 2(deg/ft)/(Btu/hr) 


All the soil is at an initial temperature of 50°F. At t = 0 the surface tem- 
perature is raised suddenly to 90°. How long will it take a point below the 
surface to attain a temperature of 85° for 

(a) a depth of 1 ft? 

(b) a depth of 5 ft? 


10-2. Simulate by either analog or digital means the problem of Figure 
10-34 when an additional transfer function of 1/(1 + s) is introduced into 
the feed-forward portion of the loop. Find the value of K that causes insta- 
bility and check against the theoretical result. 
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Appendix 10A: 

Applying the Distortionless-Line 
Principle to Simulation of 
Finite Time Delays 


Figure 10-5 shows the parameters representing one section of an electrical 
line. Such a line is called a distortionless line when 


£=+ (10A-1) 


The characteristic impedance of such a line is still given by relation (10-15); 


that is, 
i > (10A-2) 


If such a line is properly terminated (i.e., terminated by the characteristic 
impedance), then voltages applied to the input end will appear at the output 
end in an undistorted form, differing from the input voltages only because 
of the finite time delay t,, and because of a relative attenuation of A nepers. 
If the input signal is designated as x(t) and the output as y(¢), then 


y(t) = e-4x(t — 4) (10A-3) 
where ¢, is still given by the relation 
He 2 =JfleD sec (10A-4) 
p 
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and A, the attenuation, by 
A= Prd, JS _ nepers (10A-5) 
Pe 7 


The only difference between such a distortionless line and the special 
case of a lossless line is that the latter has no attenuation. An artificial-line 
version of a distortionless line is just as suitable for the purpose of simulat- 
ing a finite time delay as is that of a lossless line because the attenuation 
occurring with the former presents no problem; it can always be compen- 
sated by amplification. 

With the artificial-live version the critical frequency is still given by 
relation (10-18); it may also be expressed as 


o,= 2 (10A-6) 
ty 


where n is the number of sections used to simulate the line. Figure 10-6 
shows a typical frequency-response characteristic and how the artificial-line 
version differs from the real line in the vicinity of, or beyond, this critical 
frequency. A circuit analysis of an artificial-line version of a distortionless 
line, employing T sections, would yield the following transfer function: 


¥(s) 
X(s) 
4 
| (4s) +@+3a) ts) (4+ 4a-+3a2)( 45) +(4+4a+ 2a? 4 ay | 
(10A-7) 
where a is the attenuation per section of line, or 
A_rAu fs 
== =r hu,/— 10A-8 
on Oe oe eee ( ) 


When a = 0, the situation then becomes that of a lossless line and relation 
(10A-7) becomes 


Y(s) - | 
ole (Coe Ce 


This transfer function has nth-order poles at 


ea eet Sand ae __ 0.35 4 f1.98n 
ty ty if 


The relative pole locations are shown in Figure 10A-1. In consideration of 
these pole locations, a highly oscillatory transient response can be expected 
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with this artificial version of a lossless line. This especially would be the case 
if x(t) were a step function. Then the response of y(t) to such a step change 
of x(t) might appear as shown in Figure 10A-2. The oscillatory nature of 
the response is apparent. This “ringing” effect might be objectionable in 
situations where x(t) is expected to change rapidly and could cause a transient 
overloading of the amplifiers. It is to avoid this that the use of an artificial- 
line model of a distortionless line, having some attenuation (A < 0), is pro- 
posed instead. If n sections of such a line are employed, then the attenuation 
per section a will be 


a= 4 nepers (10A-10) 


ty —o| 


FIGURE 10A-2 


The critical frequency @, will still be the same. Substituting a = 1 in relation 
(10A-7) yields the following transfer function: 


Y(s) _ Ee . 
%0 [ (44s) ap 5(4s), [ 11(44s) i uy (10A-11) 


This function has nth-order poles at 


fm 2 ge pw 185g 
ty ta ti 
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These relative pole locations are shown in Figure 10A-3. Now the response 
is only slightly oscillatory; it shows a much more satisfactory damping than 
before. The response, after correction for the attenuation, is shown in Figure 
10A-4. 


t, 
4) j2 7 s plane 
all poles nth order 


FIGURE 10A-3 
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Examination of relation (10A-11) shows that the (d.c.) attenuation 
factor is (;,)", or #4, per section. [This factor, also expressible as (0.363)", 
does not agree exactly with the factor e~4 = e~* = (0.368)” applicable to 
the actual distortionless line. The slight descrepancy is caused by the arti- 
ficial-line approximation.] Therefore, it is necessary to introduce in each 
section an amplification factor of 44 = 2.75 to compensate for this. 

In summary, the distortionless-line model being used to produce the 
finite time delay should have the following relations between parameters: 


t, = nAu,/Ic (10A-12) 
_ Arp Brass : 
eee les ale (10A-13) 
and, from (10A-1), 
ethos noe = 
eye ZA (10A-14) 


where, from (10-15), 


S-VOL 3HNDI4 


()4 = (wx 


(uP) +1 


t 


s(u/P) + 1 
if 


(Q)x = (7)x 
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As the problem consists of synthesizing a hypothetical line rather than real 
one, the values of r, /, g, and c need not be realistic of actual lines. There- 
fore, for ease in design a fourth relation is proposed: 


Z=J—=!1 (10A-15) 


Now, the four parameters have been defined by relations (10A-12) to 
(10A-15). The solution of these equations yields 


rAu=1 (10A-16) 
gAu=1 (10A-17) 
lAu = fs (10A-18) 
c Au = fe (10A-19) 


Applying these values to the Figure 10-7 block diagram yields the result 
shown in Figure 10A-5. The transfer element Z, = 1 can of course be 
omitted. With the arrangement shown in Figure 10A-5 the following result 
should be obtained: 

yt) = GY)’x(t — 4) (10A-20) 
subject to the artificial-line approximation. It would be desirable to modify 
this diagram to recover the attenuation loss of (;,)". This can be done by 
introducing a gain of + = 2.75 in each of the n stages. Feedback-loop 
gains must remain unchanged, so gain factors equal to the reciprocal, or 
ir. are necessary as well in the corresponding feedback paths. This procedure 
and the resulting block diagram that is the basis of the analog program are 
shown in Figure 10-25. 


Parallel and 1] 
Serial Computation: 
Hybrid Computers 


11-1 Relative Advantages of Analog 
and Digital Computers 


In comparison with digital computers, analog computers possess the follow- 
ing advantages with respect to the simulation of physical systems: 


1. Because of the more direct modeling, greater insight into the 
problem is possible. 

2. Completely parallel operation is the rule. (Why this is an advantage 
is discussed in the next section.) 

3. Continuous rather than step-by-step integration is possible. 

4. A complete system response can be simulated in a minute fraction 
of the time that would be required by the fastest digital computer. 


However, the analog computer also suffers the following relative 
disadvantages: 


1. It has less precision. 
2. Its memory capacity is much more limited. 
3. It finds it difficult to generate functions of more than one variable. 
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(This even includes the simple arithmetic process of multiplication.) 

4. Program control (i.e., change of program configuration) is possible 
by means of comparators, as discussed in Chapter 4. However, 
such logical-decision facilities are much more limited in number 
than with digital computers. Also, time is required to do the neces- 
sary patching. 

5. Although functions of a single variable can be represented by 
diode function generators, these are tedious to set up unless the 
accuracy requirements are such that the method of Figure 4-14 may 
be employed. 


Other relative advantages and disadvantages depend upon whether 
the digital computer being compared is a large system, such as the IBM 360 
series, or a small system such as the PDP-9. Large systems can be operated 
economically only on the basis of batch processing or conversational pro- 
gramming on a time-shared basis. Small digital computers can be econom- 
ically devoted to just one simulation problem for a reasonable period of 
time. 

Both analog computers and small digital computers share the follow- 
ing advantages over large digital-computer systems when used for simulation. 


1. Parameters are easily varied as soon as the results being obtained 
indicate that this may be desirable. 
2. Man-machine interaction may be simulated. 


11-2 Parallel Versus Serial Operation 


With parallel operation all computations involved in a problem are carried 
out simultaneously. This obviously is the case with analog computers during 
any one simulation run; all integrators integrate simultaneously and all 
other elements function at the same time; the various steps of computation 
do not have to take their turn. 

In serial operation only one computation is performed at a time. 
This is why flow diagrams are used to illustrate the algorithms. Serial opera- 
tion is necessary with the present generation of general-purpose digital com- 
puters. 

A combination of parallel and serial operation is possible with special- 
purpose digital computers equipped with more than one arithmetic processor. 
This has been done in the case of special-purpose digital computers built 
to perform only one particular simulation function. In many simulation 
problems various computation steps were not dependent on some of the 
steps executed previously. Under such circumstances there is no reason why 
such independent computations should not be performed simultaneously. 
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As one example of this, let us suppose that parallel digital processing 
is possible and the problem of Chapter 1 is being simulated. Figure 1-31 is 
the original flow diagram for this example, based on simple rectangular 
integration. Of course, a more sophisticated method of integration would 
be used instead, Let us say, for example, that we use the trapezoidal method, 
method 2a-1. (We might prefer Runge-Kutta, but that would make the 
flow diagram more complicated than it has to be for the purpose of this 
explanation.) As the computer would be special purpose, we would not 
be using a general-purpose integration module and the integration will be 
performed as part of the main program rather than by calling a subroutine. 

Figure 11-1 is a flow diagram for such a combination serial-parallel 
program. Note that during the initializing portion of the program, prior to 
the iterative portion, there is no parallel operation. Such operation serves 
a purpose only with computation steps that are performed repetitively where 
there would be some significant time saving resulting. 

The saving in execution time that would result by adding the parallel- 
operation features in this particular example would be considerable, but not 
as spectacular as it would be with problems involving many more states. 
As the number of states increased, the saving of execution time would increase 
in an approximately proportionate fashion. 

Although the flow diagram of Figure 11-1 indicates a user-oriented 
computer language, normally such special-purpose computer configurations 
would be written directly in machine language. A simple one, as in this 
example, would probably not even use a stored program (to eliminate the time 
required to obtain instructions), but more complicated programs probably 
would. In any event, if a direct machine language was used, it probably 
would first have been tested with a user-oriented language on a general-pur- 
pose digital computer before the special-purpose computer program was 
made up. 

When parallel processing is performed, not all the parallel computation 
steps will require exactly the same amount of execution time. Some type 
of synchronization is necessary to assure that the steps to follow those 
processed in parallel fashion will not be initiated until all the preceding par- 
allel-processed steps have been completed. This usually is handled by a 
digital clock so that progress to the next step will not occur until a pre- 
arranged number of clock pulses has occurred to assure that all the preced- 
ing processes have been completed. 

The discussion here has been on the basis of parallel computations 
being “good” and serial computations “bad.” This is not necessarily true in 
all computation problems. Although parallel computations do reduce com- 
putation time, they add to the number of necessary arithmetic processors 
and to the responsibilities assigned to the main processor. However, in pro- 
blems of simulation, the subject of this book, the major cost factor with 
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FIGURE 11-1 (cont'd) 


digital simulation is the long execution time that is generally required. 
Besides costing money, this also might negate the possibility of real-time 
simulation that may be required with many problems. Often the use of 
parallel processing (when possible) does permit the digital computer to handle 
such problems. 


11-3 Hybrid Analog Computers 


The common vocabulary used to describe the degrees of hybridization of 
an analog computer is apt to be misleading. This might be clarified by des- 
cribing the step-by-step evolution of what begins as a purely analog computer 
and finally becomes a completely hybrid system. 

When various Jogical elements, to be discussed in the next section, are 
added, the analog computer starts to become what is called a hybrid analog 
computer (not a “hybrid system”). There are different degrees of hybridiza- 
tion. Even older and now obsolete analog computers could be said to be 
partly hybrid if they had some relay comparators, since, as discussed in 
Chapter 4, these do perform logical operations. The degree of hybridization 
and of sophistication increases as the relay comparators are replaced by 
solid-state comparators and gates. By the time track—hold elements have been 
added, introducing the dynamic-storage capability described in Chapter 
4, the computer already has been substantially hybridized. 

In modern terminology, especially in the sales promotion of analog 
computers, a hybrid analog computer is one where the hybridization has 
been carried still further by the addition of digital clocks, logical gates (such 
as AND or OR), flip-flops, and registers. Output will be displayable by means 
of a digital voltmeter as well as by means of an oscilloscope. But this is not 
yet a complete hybrid system because no digital computer has yet been 
added. There is no arithmetic processor and the digital-storage capability 
is limited to a few registers. 

If this hybrid analog computer is now coupled to a digital computer 
by means of suitable interface equipment, a complete hybrid system results. 
Normally, the digital computer used in this combination would be a small 
one with just enough storage capacity for the types of problems likely to be 
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handled (generally about the order of 50K). (The hybrid analog computer 
would not normally be coupled to a large system, such as the IBM 360 
series, or any system that employed time sharing.) Now each of the two 
computer portions, the analog and the digital, can be assigned the computa- 
tion functions for which it is best suited. 


11-4 Logical Elements 


One of the basic logical elements is a simple digital/analog electronic switch. 
These were already discussed in Chapter 4. The switch is simply equivalent 
to the combination of an input resistance and a single-pole single-throw 
switch inserted in the analog signal path and controlled by digital logic. 
The conventional programming diagram appears in Figure 11-2. The elec- 
trical connection between points x and y becomes closed when U = 1 (true) 
and becomes open when U = 0 (false). (Different hardware systems will 
have different electrical methods for indicating a zero or 1 condition.) 


st = ¥ 
U 


As an example of the use of such D/A switches, consider the absolute- 
value circuit of Figure 4-19c. The equivalent circuit using switches would 
appear as in Figure 11-3. In this case the switches are controlled by the out- 
puts (when x > 0, then U=1 and U = 0) of the comparator. 


FIGURE 11-2 


FIGURE 11-3 


A digital (or logical) inverter is one that reverses the logic, changing 
the “on” state (U = 1) to an “off” state (U = 0) and viceversa. This is illus- 
trated, along with the conventional symbolism, in Figure 11-4. 


os 
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U, = 1 when U, =0 
Y - =U; U, =O when U, = 1 


FIGURE 11-4 


An AND gate will have two or more inputs. The output is on when, 
and only when, all the inputs are on. The conventional symbolism is shown 
in Figure 11-5 for the case where there are three inputs. 


UY, 
a i 
U, FIGURE 11-5 


An OR gate is shown in programming-diagram form in Figure 11-6. 
Now the output U, will be zero only when none of the inputs, U,, U,, or 
U, is 1; U, will be 1 if any of the inputs are 1. Note that an OR gate may 
be made from an AND gate plus digital inverters, as shown in Figure 11-7. 


U, 
U, FIGURE 11-6 


FIGURE 11-7 


Flip-flops represent another important form of logical element; these 
are, of course, bistable devices that can be tripped between the on and off 
states by various types of input. The general symbol for them is shown in 
Figure 11-8. The number of inputs, the functions they perform, and the 
significance of the alphabetical designations attached to the various inputs 
vary from one manufacturer to the other. Generally, S means that a signal 
applied to that type of input terminal will “set” the flip-flop (i.e., make its 
state 1). Similarly, a signal applied to the R input will reset it (i.e., make its 
state zero). A signal applied to the input marked P (other symbols also are 
used) will make it reverse its state, to 1 if originally zero, to zero if origi- 
nally 1. 

Probably the most important logical part of the hybrid computer is 
the digital clock. This establishes the timing of the logical operations and 
the duration of the various analog operating modes; it assures the syn- 
chronous operation of all logical elements. The need for precise timing 


J 
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accuracy generally requires that the basic clock pulses be generated by a 
crystal-controlled oscillator. A typical crystal-oscillator frequency might 
be 1 MHz. Submultiples of this frequency, usually by factors of 10, can be 
generated as needed by means of ring-shift registers, to be discussed later. 
Together with counting registers, it is this clock that determines the precise 
timing of the operate and reset modes of the analog computer and the 
operation of other logical elements. For example, a continuous signal applied 
to the P input of a flip-flop might cause one state reversal for every clock 
pulse. 

A series of flip-flops can be made into a counting register if some way 
of “carrying” from one binary place to the next can be devised. The logical 
device for accomplishing this and other similar tasks is the differentiator. 
This device simply produces a pulse of one clock-pulse duration every time 
the input signal to it changes from zero to 1. Figure 11-9 is a diagram of the 
simple square frequently used to represent this device in a program diagram. 


[ +f : clock period 
t t 


1 


FIGURE 11-9 


Flip-flops, inverters, and differentiators can be combined to make 
up a binary counting register, as shown in Figure 11-10. The rightmost flip- 
flop represents the least significant binary bit (i.e., the flip-flops appear in 
the same way as the binary numbers would be written). When any flip-flop 
changes from 1 to zero, the differentiator sends a pulse to the flip-flop to 
the left of it, causing a carry to take place. As many flip-flops are used as 
there are binary bits needed to represent the number. 

BCD counting registers (binary coded decimal) are used when it is 
desirable to handle the logic in decimal form, as for display purposes. Four 
bits (i.e., four flip-flops) are used for each decimal place. A logic circuit 
effects a carry (i.e., sets the least significant bit of the next higher decimal 
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place) and resets (i.e., “clears”) all the bits in the present decimal place when 
a pulse arrives that would otherwise have raised the digit from 9 to 10 
(binary 1001 to binary 1010). 

Shift registers are designed to shift their contents to the next higher 
bit either at every clock pulse or else at every shift-command pulse. The 
contents of the highest bit is shifted out of the register completely and appears 
as an output pulse. This output pulse could, if desired, be the input to another, 
cascaded, shift register if more binary digits were needed in the chain. Such 
registers can be loaded in parallel (i.e., each individual bit can be loaded 
simultaneously). This pattern of 0’s and 1’s would then be shifted along the 
register once every clock or shift-command pulse. 

If the output of a shift register is fed back to the least significant bit 
of the same register, the result is a ring-shift register. This can serve many 
functions, such as obtaining submultiples of pulse frequencies, as was dis- 
cussed above. 

In summary, the hybrid analog computer does contain a collection of 
logical elements; these are, however, much less extensive in capability than 
those of even the smallest digital computer. The methods of communication 
and control that exist between the analog and logical sections are shown 
in Figure 11-11, With such a computer, the dynamic-storage operations 
discussed in Chapter 4, the search for iterative solutions discussed in Chapter 
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5, the search for boundary conditions described in Chapter 7, and the search 
for optimum parameters described in Chapter 9 will all be greatly facilitated. 
For full hybridization of analog and digital capabilities, it is necessary to 
proceed further, as is discussed next. 


11-5 Analog/Digital and Digital/Analog Converters 


Figure 11-11 shows that, up to now, there are very limited methods of com- 
munication between the analog and the logical (essentially digital) portion 
of the computer. To tie the system to a larger and more versatile digital 
computer requires a considerable extension of the interface equipment, 
especially including the addition of digital/analog (D/A) and analog/digital 
(A/D) coverters. 

Various schemes are used for D/A and A/D conversion; only the sim- 
plest will be described here. A very rudimentary D/A technique will be des- 
cribed first. 

Suppose that the analog-voltage range from —V, to +V, is to be 
covered by nine binary bits plus a tenth bit to represent the algebraic sign. 
Negative voltages are to be represented by the one’s-complement form. 
Then —V, would be represented by binary 0000000000 and +V, by binary 
1111111111, There would be a resolution of 2'' = 2048 levels, providing an 
accuracy of about 0.1 per cent of full scale. 

Figure 11-12 shows the analog and logic connections that would be 
used to convert this binary representation, stored in a register, into a corre- 
sponding analog voltage. The binary register, attached to the D/A converter, 
would ordinarily be loaded in parallel when the logic called for a D/A 
conversion. This would result in the immediate appearance of the correspond- 
ing analog voltage at the output terminal, e,. 

Note that the first gate in Figure 11-12, actuated by the sign bit, receives 
an analog-input signal V,. Hence, if the binary quantity stored were 
0000000000, only this gate would be open! (because of the digital inverter 
at its input) and the output voltage e, would be —V,, as it should be. 

As other bits are added, indicating a less negative quantity, the gates 
connected to the —V, supply become open as the output voltage increases 
algebraically and comes closer and closer to zero. When the algebraic sign 
does change and the sign bit becomes |, the first gate closes. However, the 
one’s complement then is no longer used and the lowest “positive” number, 
1000000000, meaning simply zero, would result; all gates are closed and 
e, would be zero, as it should be. Then, as the binary register attains increas- 
ing positive values, various of the gates connected to the V, supply are 


1“Open” will mean here that the analog signal is transmitted; “closed,” that it is 
not. 
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opened and an increasing positive V, results, Finally, when the register 
contains 1111111111, all gates connected to —V, are open and the voltage 
e, now finally attains its highest possible value, 0.999V, V. (Modified versions 
of the scheme described are used when the digital indication of V is in 
binary-coded decimal form.) 

The inverse type of device, the A/D converter, has been important for 
years, not only for interface equipment in hybrid-computer systems but 
also as the basic part of a digital voltmeter. One simple form of such a device 
performs this conversion by implicit methods employing a D/A converter, 
possibly one of the type just described. Figure 11-13 shows one method, 
based on the converter of Figure 11-12. Here the voltage produced by the 
D/A converter e, is compared with the voltage V that is to be converted to 
digital form. When e, > V, the U output of the comparator results in the 
clock pulse being transmitted to the subtract bus; when e, < V, the 0 
output results in the pulse being transmitted to the add bus. 
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When the computer logic calls for A/D conversion, the register of the 
D/A converter is first cleared. The ring-shift registers of the pulse distributor 
then select the sign bit of the D/A converter’s register and the first add or 
subtract pulse is sent to it. During the next clock-pulse interval, the pulse 
produced (add or subtract depending upon whether e, is greater or less than 
V) is transmitted as either the add or subtract input to bit 8 of the register, 
then to 7, and successively until bit 0 is reached. By this time the correct 
binary value of V (within the accuracy limits) will be stored in the register. 
One point is important to note to understand this operation. When an add 
pulse is received and is applied to the add input of the bit being addressed, 
if that bit already holds a 1, nothing is changed. But, when a subtract pulse 
is received and is applied to a bit that already holds a zero, the value of that 
bit is changed to a 1, but a negative carry is effected [i.e., a subtract pulse 
is sent to the next higher bit (to the left in the diagram)). 

All of this is best illustrated by example. Table 11-1 shows the sequence 
of operations when the voltage V is —2.55 V with V, equal to 10 V (the usual 
value when dealing with a hybrid analog computer). The final result of the 
conversion would be a binary indication of the voltage corresponding to 
V being —2.558 V; this is within the 0.1 per cent (of full scale) accuracy 
described. 

If this were a one-shot measurement of the voltage and conversion 
to digital form, the value now stored in the register would be transmitted for 
the next step of the computer operation. If this were a continuing operation, 
where repeated measurements of V were to be made as it varies with time (as 
would be the case with a digital voltmeter), then the contents of the D/A 
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TABLE 11-1 
Type of Pulse 
Register Content € Pulse Applied Applied to 
0 000 000 000 —10,000 Add Sign digit 
1 000 000 000 0 Subtract Digit 8 
0 100 000 000 —5.000 Add Digit 7 
0 110 000 000 —2,500 Subtract Digit 6 
0 101 000 000 —3.750 Add Digit 5 
0 101 100 000 —3,125 Add Digit 4 
0 101 110 000 —2.812 Add Digit 3 
0 101 111 000 —2,656 Add Digit 2 
0 101 111 100 —2,578 Add Digit 1 
0 101 111 110 =2.559: Subtract Digit 0 
0 101 111 101 —2,558 None None 


converter’s register would be transferred to a storage register. (If this were 
being done in a digital voltmeter, the results would be converted to decimal 
form for display purposes.) Under such circumstances, the register in the 
D/A converter would then be cleared with the next clock pulse. The clock 
pulse following this would result in the add or subtract pulse (depending 
upon the comparator’s decision) being applied again to the sign bit of the 
register as the operation was repeated. The complete sequence of operations 
previously described would then be repeated and the values in the D/A 
converter’s register would be corrected in the event the V had changed its 
value since the last cycle. 

There are a number of other methods of A/D conversion. One consists 
of the simple arrangement shown in Figure 11-14. When this circuit is placed 
in operation, the comparator will become actuated and will remain actuated 
until the negative output of the integrator —k,k,V,t attains the same mag- 
nitude as the analog voltage being converted, V, i.e., until 


k,k,V,t =V 


counter 


clock-pulse 
source 


FIGURE 11-14 
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The counter counts the clock pulses only as long as the comparator remains 
actuated and, hence, the final reading of the counter will be a measure of V. 
The method just described handles only positive values of V but relatively 
simple modifications of it will permit the handling of negative V’s as well. 
The method of Figure 11-14 is considerably simpler than that of Figure 
11-13; however, it is generally inclined to be less accurate and involves a 
longer execution time. 


11-6 Attainment of Complete Hybridization 


The tying together of the hybrid analog computer and the digital computer 
is finally accomplished by an interface which involves the digital clock, 
logic, registers, and the D/A and A/D converters just discussed, Normally, 
all control of the analog-computer operation comes from commands that 
arise at the digital end and are transmitted to the analog portion through 
the control portion of the interface. Among the control actions effected by 
the digital computer can be the setting of the servo-controlled analog poten- 
tiometers in accordance with the digital instructions. (It is also possible to 
set these potentiometers from a manually operated keyboard.) 

In addition to the control portion, the interface will include a data- 
handling portion through which digital data can appear as an analog voltage, 
and vice versa, Obviously, this is where the roles of the D/A and A/D con- 
verters become essential. 

It is difficult to describe in general the actual operation of the hybrid 
system unless the handling of some particular problem is discussed. For 
that purpose, let us consider the optimization of a control system’s parameters. 
The cost function might be 


C= Pigs dt 


where e is the system error. 

A digital program following the general form shown in Figure 8-15 
and employing the relaxation technique might be used for this purpose. 
However, the first iterative operation, described in that diagram in the block 
as “Determine the cost function... ,” would be performed in an analog 
fashion. For the first iteration, all the initial trial values of the parameters 
would have been specified during the initialization part of the program and 
would be used to set the servo-driven analog potentiometers that establish 
them in the analog program. A single, high-speed analog run would then 
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be made and the integration operation described above performed to obtain 
the value of the cost function C. At the end of this run, this value of C would 
be converted to digital form and the subsequent digital steps, starting with 
the instruction, CALL RELAX, would continue. At the next iteration a 
new value of «, would have been proposed by the RELAX subroutine; 
hence, the corresponding potentiometer would have to be reset to this new 
value before the second analog run was initiated. The program would pro- 
ceed iteratively in this fashion with «, next being adjusted after the (tem- 
porarily) best «, had been found. Finally, after a number of iterations and 
assuming that the program did not fail because of excessive trials or rounds 
(more of these, however, can be afforded than before with purely digital 
operation because of the great reduction in execution time for each run), 
the values of the optimum parameters and resultant cost function may be 
read out in digital form. While the optimization trials were taking place, 
the resulting responses could have been displayed on a cathode-ray oscillo- 
scope. 

The most time-consuming portion of the above-described procedure 
would be the repeated settings of the servo-driven potentiometer. (If the 
steepest-descent technique had been used this problem would have been 
intensified because then, for each trial, a// the parameters would have had 
to be reset.) However, all-electrical potentiometers, involving no mechanical 
motion, are being introduced to overcome such a disadvantage. 

In most hybrid applications the high-speed mode of the analog com- 
puter will be employed. However, when not many repeated runs need be 
made, normal time operation may be preferred instead. The digital-computer 
portion of the system might then be used to perform certain operations, 
such as division or finding a function of more than one variable, that the 
analog portion would have found difficult. With this type of operation the 
analog computer could be thrown into a hold mode during each of a series 
of intervals while the necessary digital computation was being carried out, 
being returned to the operate mode only after the digital computation had 
been completed and the results had been transmitted back to the analog 
portion. Analog extrapolating circuits could be used for updating the values 
of the digitally computed results in between these intervals. 

The hybrid system is the ideal answer to the problem of simulating 
finite time delays with analog computation because here it is possible to use 
basically the same digital time-delay subroutine described in Chapter 10; 
the returned values of the delayed variable would be continuously fed back 
to the analog program. In this instance, unlike the previous one, the tech- 
nique of placing the analog computer in the hold mode during the digital 
computation would no longer be necessary. 

There is now only one more step that need be made to reach the ulti- 
mate of hybridization and that step is expected with the next generation of 
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hybrid systems. It consists of digitally directed patching of the analog-com- 
puter configuration. When this time arrives, it will be possible to describe 
the analog-program configuration in terms of a block diagram expressed 
as a set of digital instructions and then let the system do the remainder of 
the programming, scaling, and patching. 


11-7 The Final Decision: Analog or Digital 
or Both (or Neither ?) 


Before deciding on the method of simulation to be employed, a question 
should first be asked: Do we want computer simulation at all? Many 
examples have been given here where the need for such simulation was 
definitely indicated. But there have been many other instances when simula- 
tion has been misapplied. The computer-simulation model will never be as 
perfect a representation as is the system being simulated itself. When the 
latter is available and tests on it are feasible, economical, and safe, why 
not use it? The author is thinking of instances when he has seen either 
students or engineers in industry developing sophisticated control schemes 
based on tests of simulation models of the systems to be controlled when 
tests performed directly on the real systems would have been practical and 
the results much more meaningful. Although it is true that this latter approach 
may introduce the usual hardware difficulties, when it does happen to be 
practical, it is the most rational. 

Now if we suppose that the need for a computer simulation model is 
definitely indicated, we are faced with the previously stated question. 

Many engineers concerned with system simulation have spent enter- 
taining hours engaged in dialogue about simulation methods. Those who 
have had their major experience with digital simulation can often see little 
to recommend the analog computer, while those whose major experience 
has been with the analog feel the same way about the digital computer, at 
least as far as simulation is concerned. At the risk of making such dialogue 
less entertaining by making it more rational, it is hoped that this book will 
have contributed some insight into the relative advantages each method 
possesses and the roles each finds the most appropriate. The only thing that 
can be added here is that the proper decision can be made only by one who 
is well acquainted with all approaches: analog, digital, and hybrid. 
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